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13. Abstract (Continued) 



a subject combines ratings on the separate dimensions to yield an overall choice 
between the pair of alternatives. Specifically, the additive . difference model 
developed by Tversky, drawing on earlier work by May and Morrison suggests that 
stable circ ular triads (i.e., intransitivities occurring in exactly the same way) 
would be expected from two administrations of the same choice pairs. 

Accordingly, five questionnaires were administered to a group of subjects 
on two separate occasions. In each case the subjects for the second adminis- 
tration were the same individuals who had completed the questionnaire the first 
time, so that data could be obtained on the responses of the same subject to the 
same pairs of choices on two distinct administrations. The principal concerns 
were the following: 

1) To find evidence for the existence of stable (i.e., over testings) 
circular triads. 

2) To investigate the appropriateness of the additive difference model, 
if such stable circularities are found. 

3) If such evidence is not found, to investigate the intransitivity-as- 
inconsistency explanation by exploring the relationship between cir- 
cular triads and changes in response to individual items over the 
two administrations. 

With the exception of one subject on one questionnaire, no such evidence 
for stable intransitivities was found. 

Consequently, the inconsistency explanation was investigated by a factor 
analysis of nine variables derived from the subjects' choices. These variables 
were measures of consistency, transitivity and discrimination among stimuli. 
Results of this analysis suggest that the assumption of circular choices as 
synonymous with inconsistency is upheld for three of the five questionnaires. 
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m INVESTIGATION OF INTRANSITIVE CHOICE BEHAVIOR 



Abstract 

Individuals are often asked to make choices from all possible pairs of 
a set of stimuli. For each pair they may have to select the alternative 
which is heavier, more preferable, more favorable to Blacks, etc. Intran- 
sitive or circular choice behavior occurs when an individual selects 
stimulus A over B, B over C, and then C over A. Such a pattern of choices 
is referred to as a circular triad. Since most theories of choice assume 
transitivity as a basic principle of human choice behavior, explanation of 
the occurrence of intransitivities is a crucial problem in the behavioral 
sciences . 

Three types of explanation have been posited for the existence of 
circular choices. One suggests that the subject is not taking the necessary 
effort to make careful choices; that is, intransitivities occur due to the 
individual's sloppiness or carelessness. Since subjects typically seem to 
make choices in a conscientious manner, this outlook is not very plausible. 
Another explanation is that intransitivities arise from the close proximity 
of stimuli on an underlying linear continuum. Thus, even though the subject 
is conscientious , the stimuli may in some cases be too similar to distinguish. 
This explanation implies that there is really no difference between in- 
transitivity and inconsistency - the reversal of responses by a subject over 
two administrations of the same pairs of choices. 

The third type of explanation concerns the development of a choice model 
which might account for intransitive behavior. Some attempts at such a 



model focus on the multidimensional nature of the stimuli , circularities 
being caused by the way in which a subject combines ratings on the separate 
dimensions to yield an overall choice between the pair of alternatives. 
Specifically, the additive difference model developed by Tversky (1969), 
drawing on earlier work by May (195*0 and Morrison (1962) suggests that 
stable circular triads (i,e. , intransitivities occurring in exactly the same 
way) would be expected from two administrations of the same choice pairs. 

Accordingly, five questionnaires were administered to a group of 
subjects on two separate occasions. In each case the subjects for the second 
administration were the same individuals who had completed the questionnaire 
the first time, so that data could be obtained on the responses of the same 
subject to the same pairs of choices on two distinct administrations. 

The principal concerns were the following: 

1) To find evidence for the existence of stable (i.e., over testings) 
circular triads. 

2) To investigate the appropriateness of the additive difference model, 
if such stable circularities are found. 

3) If such evidence is not found, to investigate the intransitivity-as- 
inconsistency explanation by exploring the relationship between cir- 
cular triads and changes in response to individual items over the 
two administrations . 

With the exception of one subject on one questionnaire, no such evidence 

for stable intransitivities was found* 

Consequently, the inconsistency explanation was investigated by a factor 
analysis of nine variables derived from the subjects' choices. These variables 
were measures of consistency, transitivity and discrimination among stimuli. 
Results of this analysis suggest that the assumption of circular choices as 
synonymous with inconsistency is upheld for three of the five questionnaires. 



ACKNOWLEDGMENTS 



The author wishes to express his gratitude to Dr. Harold Gulliksen 
for his guidance throughout this project. His advice,- criticism and 
support during the formulation of the problem, the collection of the 
data and its analysis were invaluable to the completion of this research. 

Appreciation is also expressed to the other two members of the author's 
dissertation committee. Dr. Frank Geldard and Dr. John Darley contributed 
many helpful suggestions in reviewing the earlier drafts of this manuscript. 

Many persons at Educational Testing Service assisted in the final 
preparation. Ms. Kathy Boyle typed both an earlier and the final draft. 

Ms. Frances Shaffer and Ms. Marie Davis proofread it. 

This research was done while the author was an Educational Testing 
Service Psychometric Fellow. It was supported by the Personnel and 
Training Research Program, Psychological Sciences, ONR contract # N-00014- 
67-A-0151-0006, contract authority identification NR 150-302, and by 
National Science Foundation Grant GB-8023X, administered through Princeton 
University, Project on "Mathematical Techniques in Psychology," Harold 
Gulliksen, Principal Investigator. The work made use of computer facilities 
supported in part by National Science Foundation Grants NSF— GJ— 34 and 
NSF-GU-3157. 




iii 



I 



AN INVESTIGATION OF INTRANSITIVE CHOICE BEHAVIOR 



Table of Contents 

Page 

CHAPTER I. INTRODUCTION TO THE PROBLEM 1 

1.1 Transitivity and Rationality * • 1 

1.2 Definition of Preference ..... 3 

1.3 Transitivity and Scaling . . ^ 

1.4 Intransitivity as Random Behavior 6 

1.5 Intransitivity as Inconsistency 8 

CHAPTER II. MODELS FOR INTRANSITIVE CHOICES 12 

2.1 Circular Triads and Stochastic Transitivity: 

the Luce Model 1^ 

2.2 Circular Triads and Stochastic Transitivity: 

the Coombs Model 13 

2.3 Psychological Dimensions . . 15 

2.4 Multidimensional Models . l6 

2.5 Formalization of Multidimensional Models 24 

2.6 Other Empirical Research . 31 

2.7 Intransitivity Models and Stable Circular Triads .... 32 

CHAPTER III. DATA COLLECTION 35 

3.1 Aims of the Present Study . 35 

3.2 The Stimuli * 35 

3.3 Subjects . . . 3& 

3.4 Procedure . 38 

CHAPTER IV. DATA ANALYSIS 39 

4.1 Stable Circularities . . . 40 



• Table of • content 5 ; ( continued ) 

Page 

4.2 The Luce Prediction 4l 

4.3 Intransitivity and Inconsistency - the Factor Analysis . . 47 

CHAPTER V. DISCUSSION AND CONCLUSIONS 60 

5.1 Discussion 6o 

5.2 Summary and Conclusions 64 

REFERENCES 66 



.APPENDIX I. Computation of Total Circular Triads 
APPENDIX II. General Goals of Life Questionnaire 
APPENDIX III. Payments Questionnaire 
APPENDIX IV. Occupations Questionnaire 
APPENDIX V. Offenses Questionnaire 
APPENDIX VI. Vietnam Questionnaire 

i 

i 

i 

i 

i 











List of Tables 



f V- 




Table la. Matrix of Totals for Goals of Life Questionnaire .... 1*2 

Table lb. Matrix of Totals for Occupations Questionnaire 1*2 

Table lc. Matrix of Totals for Offenses Questionnaire 1*3 



Table Id. Matrix of Totals for Vietnam Questionnaire 1*3 

Table le . Matrix of Totals for Payments Questionnaire 1*1* 



Table 2. Triad Matrix for Subject #1*2 on Payments Questionnaire . 1*5 

Table 3. Test of Luce ' s . Symmetric Intransitive Triads Prediction. 1*6 



Table 1*. Number and Type of Stimulus Changes **8 

5a. Correlation Matrix for Vietnam Data • .51 

# : $£}le 5b. Correlation Matrix for Occupations Data .... . . . .51 

Table 5c. Correlation Matrix for Offenses Data 52 

Table 5d. Correlation Matrix for Goals of Life Data 52 

Table 5e • Correlation Matrix for Payments Data . .53 

Table 6. Factor Loadings for the Vietnam Data . . . .51* 

Table 7. Factor Loadings for the Occupations Data 51* 

Table 8a-. Factor Loadings for the Goals of Life Data 56 

Table 8b. Correlations between Factors for the Goals of Life Data. 56 

Table 9a. Factor Loadings for the Offenses Data . -57 

Table 9b. Correlations between Factors for the Offenses Data . . . 57 

Table 10a* Factor Loadings for the Payments Data . .... . . . .58 

Table 10b. Correlations between Factors for the Payments Data . . . 58 



vi 





* 



CHAPTER I 



INTRODUCTION TO THE PROBLEM 

If an individual prefers a stereo set to a new suit, and a new suit 
to a television, is it certain that he prefers a stereo set to a television? 
Previous investigation of human choice behavior has shown that individuals 
often make the enigmatic response of television over stereo. This is an 

b 

example of intransitivity of choice in which A is chosen over B, B is chosen 
over C, and then C is picked over A. Since, as we shall see, most theories 
of choice assume transitivity as a basic principle of human behavior, 
explanation of the occurrences of intransitivity is a crucial problem in 
the behavioral sciences. 

1.1 Transitivity and Rationality 

Before considering any such explanations let us speculate on why transi- 
tivity of choice is so often a necessary axiom to theoretical developments 
of choice behavior. First of all, from a purely philosophical viewpoint, 
transitivity is usually considered one of the essential criteria of a 
rational decision. Edwards, Lindman and Phillips ( 1965 ) in their reading 
of the philosophical literature on rationality found that 11 ...20 or 30 
criteria by which a rational decision can be distinguished from an irrational 
one have been proposed and seriously studied" [p. 272]. Although considerable 
disagreement, .exists about the necessity of many of these criteria, they state 
that one of the few un controversial principles of rationality is the principle 
of transitivity. 

Davidson, McKinsey and Suppes (1955) consider a set K of alternatives 
and the relations E , which holds between two alternatives that are equivalent 



in preference, and P , which holds when one alternative is definitely- 
preferred to another. They then define a rational preference ranking as 
the triple < K,P,E > if and only if 



1. 


The 


relation 


P is transitive. 


2. 


The 


relation 


E is transitive. 


3. 


If 


x and y 


are in K , then exactly one of the following: 




xPy 


, yPx, xEy 


• 



While the third condition merely requires that it be possible to compare the 
alternatives, the first two again establish a formal. condition of transitivity 
as necessary for rationality. 

Naturally, the above normative considerations do not in any way deny 

the existence of intransitivities. Rather, they imply that 

. . .we ordinarily would admit that such intransitive patterns 
of judgment or decision are mistakes , and that truly rational 
choices would be transitive. In fact, a man who was deliberately 
and systematically intransitive could be used as a money pump. 

You might say to him: "Here, I’ll give you pork chops. Now, 

for a penny I’ll take the pork chops back and substitute 
lobster for them.” Since he prefers lobster to pork chops, he 
accepts . Next you offer to replace lobster with steak for 
another penny , and again he accepts . You complete the cycle 
by offering to replace steak with pork chops for still another 
penny, and since he prefers pork chops to steak, he again 
accepts, and thus is three cents poorer, back where he started, 
and ready for another three cent round [Edwards, Lindman & 

Phillips , 1965 , p • 273] . 

While Edwards and his associates polemicize convincingly against making 
intransitive decisions , they categorize any violation of transitivity as 
a "mistake" and thus imply that there is no possible descriptive model 
for their explanation. Indeed, they conclude that the fact that "...we 
have never met such a money pump suggests that no one is in fact deliberr. 
ately and systematically intransitive" [p . 273]. Personal acquaintances 



to the contrary, the possibility Of systematic intransitivities will be one 
of the major concerns of this investigation. 

1.2 Definition of Preference 

In the Davidson, McKinsey and Suppes formulation above, P and E 
correspond to a strict "preferred to" (>) and an "indifferent to" ( = ) 
relation respectively. The preference relation is often formulated as the 
combination of these two (>) . In this case if preference is transitive, 
then each of its components must be transitive. We shall only consider 

the relation of strict preference here. 

Transitivity of indifference has long been doubted and does not seem 
to have the same intuitive appeal as transitivity of strict preference. 

Early psychophysical investigations of Weber and Fechner were concerned with 
determining the least difference between two stimuli which can be noticed 
(Fullerton & C& + ill, 1892). Thus any trial composed of two "just noticeable 
stimuli" and some stimulus between these two (on the underlying physical 
continuum) would produce an intransitive indifference relation. 

Luce (1956) quotes Armstrong as stating 

. . .the nontransitiveness of indifference must be recognized and 
explained on (sic) any theory of choice, and the only explana- 
tion that seems to work is based on the imperfect powers of the 
human mind whereby inequalities become recognizable only when of 
sufficient magnitude [p. 179]* 

Empirical evidence from psychophysics furnishes support for this view. Luce 
considers an individual who prefers a cup of coffee with one cube of sugar to 
one with five cubes. Now, if there are 1+01 cups of coffee with (l + i/100 )x , 
i ~ 0,1,... 1+00, x = the weight of one sugar cube, the subject will be indiffer 
ent between any cup 1 and cup i + 1 , but not between i = 0 and i - 1+00 



Both Luce (1956) and Krantz (1966) have pursued the implications of a 
preference system in which the indifference component may be intransitive. 

1.3 Transitivity and Scaling 

In addition to its necessity as a formal condition for rationality , 
there is a still more compelling basis for the transitivity assumption in 
actual empirical work. Often we seek to create some sort of scale such 
that the number assigned to a given alternative on this scale is greater 
than the number assigned to some other alternative if and only if the former 
is preferred to the ldtter. In other words we seek to map the set of 
empirical preference relations on these objects onto some subset of the 
real number system. Since the number system is clearly transitive, there 
can be no numerical representation if the preferences are not transitive. 

As Quandt (1956) has pointed out in discussing transitivity, "...without 
this axiom one can construct neither an ordinal preference map nor a 
cardinal utility index" [p. 507]. 

Since many individuals do not make the same choice each time they are 
faced with the same pair of alternatives, preference is often defined in a 
probabilistic fashion, and one alternative is said to be preferred to another 
if it is chosen over the other more than 50 per cent of the time. If 
p(x,y) is the probability that x is chosen over y , then x is preferred 
to y if and only if p(x,y) > 1/2 . Consequently transitivity may also be 
defined in a probabilistic manner as opposed to the algebraic transitivity 
which we have been discussing above. Marschak (• 19 60 ) reviews three types 
of probabilistic or stochastic transitivity. Strong stochastic transitivity 
states that if x is preferred to y and y is preferred to z , then x 



will “be preferred to z at least as much as the greater of the above pair 
of preferences . Symbolically , 

p(x,y) £.1/2, p(y,z) >.1/2 implies p(x,z) >. max [p(x,y) ,p(y ,z ) ] . 

Moderate stochastic transitivity states that x will be preferred to z 
at least as much as the smaller of the pair, or 

p(x,y) >.1/2, p(y,z) >_ 1/2 implies p(x,z) >_ min [p(x,y) ,p(y ,z ) ] . 

Finally, weak stochastic transitivity implies only that x will be 
stochastically preferred to z . That is, 

p(x,y) >. 1/2, p(y,z) >_ 1/2 implies p(x,z) £.1/2 , 

A brief survey of the major measurement models will show that some form 
of transitivity is either a basic assumption or an immediate consequence 
of the basic assumptions. The literature on conjoint measurement 
(Krantz, 1961+; Luce, 1966 ; Luce & Tukey, 1961+; Tversky, 1961+, 1967a) 
in each case begins with an .axiom requiring algebraic transitivity of 
some empirical relation on the objects or alternatives in order to 
develop the model. Tversky and Russo (1969) show that if strong stochastic 
transitivity is defined so that strict inequality in both hypotheses entails 
strict inequality in the conclusion, then it is equivalent to the assumption 
of simple scalability. Simple scalability exists if there are functions 
F and u such that for all alternatives, 

p(x,y) = F[u(x) , u(y ) ] , 

where F is increasing in u(x) and decreasing in u(y) . Thurstone's 
(1927a) Case V and Luce's (1959) choice model both depend on a special 
case of the above equation in which F is a function of the difference 



between u(x) and u(y) : 

p(x,y) = Ffu(x) - u(y)] . 

Since Tversky and Russo derive their stronger formulation of strong stochastic 
transitivity from the above equation, it is evident that it (SST) also may be a 
suitable assumption from which to develop Thurstone’s Case V or the Luce model. 
Morrison (.1962 , Appendix A) has shown how moderate stochastic transitivity can 
be derived from Thurstone's Case III, and Morrison (1963) and Luce and Suppes 
(1965) both present further relationships between various choice models and 
the different types of stochastic transitivity. 

1.4 Intransitivity as Random Behavior 

Despite the obvious appeal of transitivity as a basic assumption about 
choice bdiavi or, intransitivities frequently occur in empirical work. Typically 
data in such work are collected by the method of paired comparisons in which 
the set of stimuli or alternatives is presented to each subject or judge in 
all possible pairs. Thus for - n stimuli there are n(n^l)/2 possible pairs. 
In this way transitivity can be investigated by looking at each stimulus triple \ 
intransitive triples are also referred to as circular triads • The computational 
details of circular triads were first discussed by Kendall and Smith (1940) 
in which they derive expressions for the maximum possible circular triads 
for n stimuli presented in a paired comparisons schedule. Kendall (1962) 
presents the derivation of formulae for computing the total circular triads 
(TCT’s) made by an individual in a comparisons task (see Appendix I). He 
also presents a statistical test to determine whether the number of TCT's 
made by a given subject is significantly less than the number of TCT’s expected 
if the subjects were responding at random to the stimuli. 
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Three explanations have been posited for the existence of intransi- 
tivities in paired comparisons data. Two of these will be discussed below, 
while the remaining one will be developed in Chapter II. The first is 
that the subject may be making choices purely at random. While it would 
seem that this hypothesis is ideally suited for investigation by Kendall's 
statistical test described above, Morrison (1962) has pointed out an 
interesting problem in this approach. Suppose that a subject sets out 
with the "diabolic" intent of producing as many circular triads as possible, 

...He accomplishes this by predetermining his complete paired 
comparison choices for all stimuli and then choosing on the 
basis of this internalized paired comparisons structure at 
every opportunity . Not all the triples of pair-wfise choices 
can be intransitive if... (the number of stimuli) .. .is greater 
than three, since each choice is included in a number of 
triples [p. llj, 

For n stimuli there are (^) total number of triads, while the maximum 
number of circular triads that could be made is n(n - l)/24 . Thus the 
maximum proportion of circularities is given by 



n(n 2 - 1)/2U _ n(n> l)(n - l)/ 2 k _ 
/n N n(n - l)(n -2) 

3 Z 



n + 1 



V(n - 2) • 



As n. gets very large, this ratio obviously approaches .25 • In other words 
the diabolic subject through his systematic choices can ensure that 25 per 
cent of the triads will be circular. Now Kendall's test is based on a chi 
square approximation to the number of circularities expected from random re- 
sponses . If the number of circularities from maximum to minimum, is plotted on 
the abscissa, then relatively low frequencies falling past a cutoff point on the 
right tail of the distribution imply a rejection of the "random" hypothesis. 
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Consequently , there would be no way, utilizing Kendall's test, to distinguish 

between the randomly intransitive and the deliberately intransitive individuals. 

i 

l 

| 

; 1.5 Intransitivity as Incons i stency 

i 

Another explanation suggests that intransitivities arise from the degree 
of separation of two stimuli on an underlying linear continuum. Whereas the 
! first explanation assumed that the stimuli are distinguishable and the subject 

1 

is not paying attention, this one supposes that the stimuli are similar and 
the subject makes a sincere effort but has difficulty telling them apart. 

| This possibility is especially appealing since it allows the retention of 

{ transitivity as an assumption about preference behavior and treats circulari- 

| ties as errors or mistakes resulting from the subject's imperfect discriminative 

i 

i abilities, typical of this outlook is Hill ( 1953 )? 

I 

If the rationale underlying the method of paired comparison 
scale construction is valid, then the occurrence of inconsistent 
judgments of objects should increase as the difference between 
those objects on the underlying continuum decreases. In other 
words the greater the difference between objects with respect 
to the attribute being judged, the less likely these attributes 
are to be judged inconsistently [p. 565]. 

In support of this contention Hill showed that an inverse relationship 

existed between the frequency of occurrence of a circularity and the scale 

distance between the extreme members of an item triad. He concludes that 

”, . .the greater the psychological distance between objects , the less likely 

the objects are to be judged inconsistently” Ip. 566]. Interestingly, Hill 

uses the term "inconsistency" rather than circularity or intransitivity. 

Such terminology implicitly precludes any explanation of circularities which 

might be "consistent" with some criteria. 

f. 

>. Other writers have also made the assumption that intransitivity may 

| be equated with inconsistency* and. that a circular triad produced by the 

I 1 18 . 
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subject may, in some sense, be considered an "error." Koslin and Pargament 
(1968) and Koslin, Suedfeld and Pargament (1968) both used circular triads 
as a measure of discrimination errors by subjects, "...assuming that the 
preferences among stimuli form a linear scale, and that circular triads 
arise in practice because subjects cannot distinguish stimuli from one 
another" [Koslin & Pargament, 1968, p. 6]. 

Sadacca (1962) first reviews a number of measures of intraindividual 
variability. He points out that the most frequent index of such variability 
is the number of changed item responses when a particular test or inventory 
is administered to the same individual on two occasions. This variability 
is usually treated as unreliability and assigned to error variance (Fiske 
& Rice, 1955). Sadacca himself then uses circular triads as an operational 
measure of .inconsistency of judgment, intra- individual variability being 
inferred by the lack of consistency in responses" [1962, p. 13]. Thus he 
assumes that there is really no basic difference between circular triads and 
reversed responses over testing occasions. — each is a measure of intraindividual 
variability. By factor analyzing the circular triad scores obtained from 
paired comparisons schedules using a number of different types of stimuli, 
Sadacca concludes that such inconsistency is a general trait, "...subjects 
who were inconsistent, in making judgments of one set of stimulus pairs tended 
to be inconsistent in judging other sets of stimulus pairs, regardless of 
the type of judgment and kind of stimulus involved" [1962, p. lU8]« 

A n umb er of investigators have pursued the relationship of intransi- 
tivities (assumed to be inconsistencies in the sense of Hill and Sadacca) 
to other variables. Gulliksen, Saunders and Tucker (195*0 found a curvi- 
linear relationship between the number of circular triads produced and^the 
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grades of college students, with the best grades being made by students 
at about the 75th or 80th percentile of consistency. However, they found 
no correlation between such response consistency scores and other predictors 
of academic achievement. Hills and Raine (1958) found essentially no 
correlation between circular triad scores and grades in law school or 
scores on the LSAT. 

Some researchers have even ascribed moral overtones to the production 

of intransitivities. Benson (1958) claims that "...if the respondent 

displays circularity of reply in making choices , one or more of the choices 

is invalid. . ."[p. 286] and that "...TCT may reflect the attentiveness or 

honesty with which respondents make their choices" [p. 287]. Accordingly, 

Benson describes a study comparing the consistency of subjects taken from 

Annandale Reformatory with subjects from Drew University. 

The purpose of this study was to see whether TCT can be used to 
differentiate between reliable and unreliable respondents. Those 
who fabricate their replies may be unable to do so as consistently 
as if they reply honestly , following the natural order of their 
personality traits. The hypothesis tested is that reformatory in»< 
mates are more inconsistent than college students ... [p . 287]. 

Since the differences between these groups were not statistically significant 

/ 

Benson concludes that "...TCT is a variable of little usefulness in distinguish^ 

ing between paired comparisons replies of criminals and noncriminals , and by 

implication, is of little value as a check upon honesty." 

Davis (1957) also suggests the possibility of measuring how 

...conscientiously a subject fills out a questionnaire by the use of 
circular triads, because the un conscientious subject would make a great 
many. It might also be possible to measure how much a subject fakes a 
questionnaire because, although. the subject can fake some items consis- 
tently, he probably would not be able to fake a great many items without 
making circular triads [p. 22].. 




4 




i 



Curiously the Davis study found a correlation of .46 (.01 lower bound = . 16 ) 
between the number of circular triads made by a subject and his score on the 
McClelland Need Achievement Thematic Apperception Test. Davis interprets this 
finding as indicating that subjects with low need achievement perhaps made a 
"...more conscientious effort to state their preferences" [ 1957 , P« 24 ]. The 
implicit assumption is that a subject responding "conscientiously" will 
produce fewer intransitivities than one who is careless. 
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CHAPTER II 

MODELS FOR INTRANSITIVE CHOICES 

Some researchers have suggested that circularities are- the product neither 
of random responses nor of inability of the subject to discriminate. Accord- 
ingly they have worked on the development of descriptive models focusing on 
how and when such circularities will occur. Attempts at such models have 
taken a number of directions. 

2.1 Circular Triads and Stochastic Transitivity; the Luce Model 

The Luce model views circular triads as an epiphenomenon due to the 
stochastic definition of preference. It is assumed (Luce, 1959) that the three 
pairwise choices constituting a triad are statistically independent and thus 
the probability of a circularity of the type x over y, y over z, z over x is 

merely the product p(x,y )p(y,z)p(z,x) . 

The Luce model has as its basic assumption the choice axiom which states 

in part 

Let T be a finite subset of U such that, for every Sc T, P g is 
defined. If p(x,y) ^ 0,1 for all x,y e T, then for R c S c T, 

P t (R) = P g (B)P T (S) (!) 

That is , the two choices — choice of a particular subset S from the set of 
stimuli T, and choice of a further subset R from the set S~-are independr- 
ent. In other words the probability of choosing R does not depend on how T 
is partitioned to form S . From this axiom it may be shown (for details, see 
Luce, 1959, p. 9, Lemma 3) that 



With this result Luce can now prove a theorem which states 

If the choice axiom holds for {x,y,z}, and if none of the pairwise dis- 
criminations is perfect, then 

p(x,y)p(y ,z)p(z,x) = p(x,z)p(z ,y)p(y,x) (3) 

since, if T = {x,y,z} 

P T (x) P T (y) P T (z) 

P T (y) p t (z) ? T (x) “ 1 » 

then by (2) , 

P.(x>y) , p (y>z) p(z,x) = 1 

p(y,x) p(z,y) p(x,z) 

and the theorem follows immediately. However, the left hand side of (3) is 
just the probability of obtaining a circularity of the type x over y , y 
over z, z over x, while the right hand side is the probability of the oppo- 
site type of circularity, x over z, z over y, y over x , Thus the Luce 
Model predicts what Morrison (1963) terms symmetric intransitive triads (SIT)-- 
the frequency of intransitive triads which cycle in one direction should be 
equal to the frequency of those which cycle in the opposite direction. 

2.2 Circular Triads and Stochastic Intransitivity; the Coombs Model 

Coombs' (19614, Chapter 5) development of the unfolding model assumes that 
an individual has an ideal point on the continuum underlying his choice, and in 
each case he makes a decision by comparing the distances of the two alternar 
tives from his ideal point, and choosing the closer. However, a pair of stimuli 



do not necessarily lie on the same side of the ideal point. A unilateral pair 
is one in which the stimuli are both on the same side of the ideal, while a 
bilateral pair is one in which they are on opposite sides. Now, variability 
(i.e., a probability distribution over the ideal point) in the location of the 
ideal will not affect the consistency of judgment on the unilateral pairs, but 
it will affect the bilateral pairs. As Coombs describes it the two bilateral 
distributions are "...rolling over each other in opposite directions as the 
ideal varies, whereas a pair of unilateral distributions slides back and forth 
locked tightly together" [1964, p. 108] . 

The concept of laterality now leads to three distinct types of triples . 

A unilateral triple is one in which all three stimuli are on the same side of 
the ideal. A bilateral adjacent triple and a bilateral split triple are # 
instances in which one of the three stimuli is on the opposite of the ideal 
from the other two. In the former case this single stimulus is either first 
or last in the ordering of the triple with respect to absolute distance from 
the ideal, while in the latter case the single stimulus comes between the other 
two on this ordering. Thus in a bilateral adjacent triple the first and last 
stimuli always constitute a bilateral pair with one unilateral and one bi T 
lateral pair between them, while for bilateral split triples , the first and 
last stimuli constitute a unilateral pair with two bilateral pairs embedded 
between. 

Now consider the effect of variability of the ideal point on each type of 
triple. The unilateral, triple, being composed of three unilateral pairs, 
naturally is not affected at all, However, the bilateral triples are affected 
since they both contain embedded bilateral pairs. If the bilaterality is 



m 



I 



i 



! 



« 

i 



I: 

h 

f: 

l- 

y. 

■ 

& 

iv ' 
sy 



I 

fe 



#**» 

1 



«:• 

p:.. 



ERIC 



rJ.5^ 

adjacent, variability of the ideal will cause increased inconsistency in the 
pairing of the two extreme stimuli of the triad, and hence the degree of 
stochastic transitivity will decrease. However, if the bilaterality is split 
there will be greater inconsistency in the judgment of the nonextreme pairings 
and no effect on the extreme pair, tending to increase the degree of stochastic 
transitivity. 

Coombs performed an experiment designed to test predictions derived from 
the above analysis (see Coombs, 1958 or 1961* for details). In general the 
results tend to confirm these predictions. However, the data were not col«- 
lected by the method of paired comparisons . Instead paired comparison choice 
probabilities were estimated from the subject's rankings of subsets of four 
stimuli (there were a total of twelve stimuli in the investigation). 

Of course the Coombs model is applicable only to situations in Xrtiich 
transitivity is defined stochastically, and even here, the model will not apply 
to violations of weak stochastic transitivity. 

2.3 Psychological Dimensions 

Models dependent upon a multidimensional characterization of the subject's 
judgments have also been posited as a rationale for circular triads. However, 
before proceeding to a discussion of these models, let us clarify what is meant 
by the use of the term "dimension." 

Tversky and Krantz (;1969a) point out that the concept of a psychological 
dimension has been used in several different senses in the literature. One 
meaning attributed to it is a variable that can be experimentally manipulated, 
such as the frequency of an auditory -stimulus or the length of a geometric fig*- 
ure. From a psychological standpoint this use of the term dimension is neutral, 

■ *\1- 
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since it refers to the physical characterization of stimuli, not to the way in 
which they are perceived. A second meaning of the concept of dimension is some 
variable that cannot be measured or observed directly, but is expressed in 
terms of a number of directly observable variables. Some factor analytic 

i 

definitions, such as Spearman's g or Thurstone's primary abilities are examples 
of dimensions defined as combinations of measurable variables such as test 
scores. In this case the actual measurement procedure (though not, as Tversky 
and Krantz point out, the interpretation of the dimensions) is not dependent 
on any testable psychological assumptions. Instead it is a method of data 
reduction — a large number of correlated variables is expressed in terms of a 
smaller number of uncorrelated ones . 

Finally, the most interesting meaning of the term dimension refers to 
the factors along which stimuli are perceived. ".. .In speaking of hue, satura r 
tion, and brightness as dimensions of color space, of potency as a dimension 
of semantic space, it is typically implied that these dimensions serve as 
organizing principles in the perception of colors or words" [Tversky & Krantz, 
1969a, p. 38], Of course this does not imply that dimensions of this type are 
necessarily different from those described in the first definition above. The 

frequency of a sound, the length of a line, or other experimentally controlled 

/ . 
t 

variables may, indeed, have some functional relationship to the organizing 
principles extracted when a subject perceives the given stimuli, 

2.k Multidimensional Models 

Prior to the actual development of a multidimensional model which might 
underlie intransitivity, some investigators in allied fields (to choice behavior) 
had made allusions to the possibility of such a model. McCulloch (19^5) 



investigated circularities in neural switching circuits and suggested that 
"...circularities of preference, instead of indicating inconsistencies, actually 
demonstrate consistency of a higher order than had ever been dreamed of..." 

[p. 93]. Rapoport (1949), in his consideration of the intransitivity of the 
"peck right" relation in a society of animals, formulates the problem thus:* 

A > B if and only if f (A,B) > f(B,A) 

B > A if and only if f(B,A) > f(A,B) 

where f is a certain function, whose " , . . arguments are the respective ’char- 
acteristics’ of the individuals involved in the peck right relation" [p. 186 ]. 
Rapoport goes on to point out that transitivity will always hold if f is a 
function of a single variable, but if f is a function of more than one varU 
able (i.e., a multidimensional situation), then f may easily be constructed 
so that an intransitive pecking relation results . 

The first more detailed exposition of this type of model is due to May 
(19510 . He considers the choice alternatives in terms of their “components" 
and suggests that a given stimulus may be characterized as a vector = 

(x x , . . . ,x ) whose elements correspond to ratings on the m components 
i.1, i2 im 

or dimensions. A circular triad may now arise depending on the way in which 
an individual combines ratings on these separate dimensions to yield an 
aggregate preference between two stimuli. For example, consider a paired 
comparison schedule, administered to a group of students, which requires each 
one to indicate his preference among pairs of restaurants. In this case the 
salient dimensions might well be postulated as follows : 

111 ip ■ 1 1 • ■ 

* V 

A > B is read A pecks B • 
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I How good the food is 
II How late the restaurant is open 
III How inexpensive the food is. 

Possibly there are three restaurants which some particular student rates in 
the following manner: 





I (Good) 


Student 


medium 


Center 




PJ's 


low 


Annex 


high 



II (Late) 
high 

medium 

low 



III (Inex) 
low 

high 

medium 



According to May, if this student makes his choices on the basis of which stimulus 
has a higher rating on the greater number of dimensions, then a circular triad 
of the form. Annex preferred to Student Center, Student Center preferred to PJ‘s, 
PJ's preferred to Annex will result. However, May ignores the fact that if 
selection is based on the criterion that only the difference between ratings of 
low and high are meaningful (i.e., comparison of high-medium and medi tim-low are 
ignored), the opposite circular triad will be obtained. 

To investigate his model empirically. May had 62 college students make 
paired comparison choices from three hypothetical marriage partners. The first 
hypothetical partner was described as vexy intelligent, plain looking and well 
off; the second as intelligent, very good looking and poor; and the third as 
fairly intelligent, good looking and rich. The subjects were told that the 
prospects were to be considered acceptable in every other way, none being so 
poor, plain or stupid as to be eliminated. The results are not reported in 
any detail and May is rather inconclusive. He suggests that 11 ...where choice 



28 



1 



A 






! 



-19- 




i 

i 

i 




S 

Y 



1 

| 



1 

i 



O 

ERIC 



depends on conflicting criteria, preference patterns may be intransitive unless 
one criterion dominates" [May, 195^, p. 7]» 

The political science literature contains an interesting problem termed 
the legislative paradox which is quite similar to the above analysis in its 
formal aspects. However, May's explanation refers to the circularities found 
in individual preferences, while the legislative paradox concerns the cir- 
cularity of preference when pairs of alternatives are presented to a group and 
a decision is made on each pair through majority vote. McGarvey (1953) has 
proven a theorem which states that given any preference pjattern--transitive or 
intransitive — a group of individuals exists with transitive individual prefer- 
ence orderings such that the group preference pattern as determined by the 
method of simple majority decision is the given preference pattern. 

Savage (1951; see Luce & Raiffa, 1957, pp. 280-282) has suggested the 
minimax risk criterion as. a model for individual decision making under uncer- 
tainty. If this model is used in making decisions between pairs of acts, 
intransitivities may result from it. The situation to which it applies occurs 
when the result of an individual choice depends upon what "state of nature" 
exists subsequent to the choice. Each act or choice (A^) yields a different 
payoff contingent upon which state (S^) turns out to be the true state. 
Savage defines "risk" or "regret" of a particular choice given the occurrence 
of some state as the difference between the payoff for that choice and the 
highest payoff for the particular state of nature. For example, consider the 
following matrix of payoffs : 



1 

10 






29 



2 



8 
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If S 1 is the true state of nature, then there is no risk or regret if A x 
is chosen since the individual has obtained the highest possible payoff (10) 
given that occurs j but there is the risk of eight (of whatever units in 

which payoffs are considered) if A 2 is chosen — the difference between the 
maximum payoff in that state and the payoff obtained from the choice made. 
Thus the above payoff matrix leads to the following regret matrix: 



A 1 ° 

A 2 8 



h 

o 



The min imax risk proposed by Savage suggests that the alternative be chosen 
which minimizes the maximum risk. In this case it would be A^ since four 
is less than eight. 

Now consider the following matrix (Luce & Raiffa, 1957, p. 282) of payoffs 



1 

10 

0 

5 



5 

10 

2 



1 

k 

10 



This matrix leads to the following regret matrices when pairs of choices are 
considered: 



A i 



1 

0 



A 2 10 



5 

0 



3 

0 
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a 2 506 

A 3 080 

A 0 0 9 

A 3 5 3 0 



Savage's procedure yields the circularity: 

i) picked over A^ since A^ has a maximum risk of 5 (in S^) while 
Ag has maximum risk of 10 (in S^) . 

ii) A picked over A since A_ has maximum risk of 6 (in S ) while 

2 3 2 J 

A^ has maximum risk of 8 (in S^), 

iii) A^ picked over A 1 since A^ has maximum risk of 5 (in while 
A^ has maximum risk of 9 (in S^) , 

Formally this intransitivity is similar to the condition in May's model in which 
choices are made on the basis of high-to^low differences only. The primary 
distinction between the two models is with respect to the different empirical 
situations to which they would be relevant. In the May explanation , the choice 
occurs under certainty (i.e., the individual is aware of the results of his 
decision with probability one), and circular responses result from the multi- 
dimensionality of the stimuli. In Savage's discussion dimensionality of the 
stimuli is ignored, and possible intransitivity is a result of the differential 
effects of the possible states of nature. 

Quandt (1956) develops a model of choice intended to apply particularly 
to cons ume r behavior. He argues that each commodity may be regarded as a col»> 
lection of "primitive characteristics," such as size, weight, color, etc. and 
that a complete ordering exists among these primitive characteristics. Not 
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all the primitive characteristics are^equally important in making a particular 
choice. Quandt even suggests that the characteristics of the same commodity 
may be weighted quite differently depending on external circumstances sur r 
rounding the choice situation, such as whether the individual is choosing 
alone or in the company of friends. When two commodities are compared, there 
is some probability that he will base his evaluation on the i characteristic 
of one and the j th characteristic of the other. The probability of con- 
sidering a particular characteristic of commodity A may or may not depend 
upon the particular B characteristic being considered. According to Quandt, 
when such a dependency does exist, intransitive choices may result. Consider 
a choice which must be made between, say, a coat and a pair of shoes. The 
Quandt model is concerned with measurements of, for example, the joint prob- 
ability that the desirability of the shoes is judged on the basis of their 
color and the desirability of the coat is judged by the type of cloth. 

Shepard (l96ta.) has presented a discussion of the effect of the "multi- 
attribute" nature of alternatives upon the choice process. In his opinion one 
source of the "subjective nonoptimality" of decisions (which includes the case 
of intransitivity) is an individual's inability to take account, simultaneously , 
of all the components of the alternatives. That is, although he may have no 
difficulty in judging the set of alternatives with respect to any particular 
attribute, Shepard feels he may experience difficulty in combining his evalua- 
tion of the separate attributes into a global judgment of the alternative. 
Consequently, there may be "...a consistent tendency for the subjects .. .(to 
rely)... too heavily on one or two of these factors while, in effect, ignoring 
the significant contributions of the remaining factors" [Shepard, 1961+a, p, 265]. 



Shepard (1964b) describes a study in which this "attentional phenomenon" 
seems to have been present. The stimuli in this research were a number of 
circles with a radial line, or spoke, drawn in on each circle. These stimuli 
varied on two physical dimensions — the size of the circle and the angle of the 
spoke. Subjects were asked to select which of the set of stimuli was most 
similar to a standard stimulus. . Shepard found that a number of subjects dis«- 
played a tendency to match either the size or the inclination of the standard, 
thus making judgments on the basis of whichever dimension was momentarily 
salient. It seemed that subjects were "...capable of switching between 
orderings of the alternatives in which one of the two dimensions completely 
dominates the other" [Shepard, 1964a, p. 273]. 

The "switching" which Shepard describes may result in choices which re- 
semble a lexicographic semiorder. A lexicographic ordering is one in which 
stimuli , are ordered on the basis of ratings on the first component or dimen- 
sion. If two stimuli have the same rating on this first dimension, then the 
"tie" is broken by the ordering on the second dimension, and so on (a typical 
example would be the alphabetic ordering in a dictionary). Obviously there 
can be no intransitivities in a lexicographic order. A lexicographic semi order 
occurs when, due to imperfect discriminative ability, the subject's rating of 
"equality" of two stimuli on the first dimension is not transitive (as with 
Luce's cups of coffee in Section 1.2). Thus, in making a judgment between pairs 
of stimuli A-B and B-C, the subject may in each case perceive equal ratings on 
the first dimension and so make his decision on the basis of ratings on the 
second dimension. However, for the pair A-C, the subject does not perceive such 
equality and so decides on the basis of ratings on the first dimension. It is 
evident that such a decision process may produce a circularity. For Shepard's 
stimuli perhaps subjects are using, say, the size dimension of the circles to 



make a judgment until the difference in size becomes relatively small causing 
a switch to the "angle" dimension as a basis for judgment. 

2.5 Formal i zation of Multidimensional Models 

One of the first attempts to formalize the effect of multidimensional 
choice alternatives on transitivity was made by Morrison in his doctoral disserta- 
tion (1962). He began by assuming that each stimulus could be represented as a 
series of component values on the first through the n dimensions . Thus 
stimulus X = (x^ ,Xg,. . . ,x n ) where each x^ stands for the magnitude of X on 
the i th attribute. Morrison then postulates the existence of a decision func- 
tion, D(X,Y) , such that X is chosen over Y if D(X,Y) is greater than zero. 
Consequently , a circular triad will result if D(X,Y), D(Y,Z),.and D(Z,X) are all 
greater than or all less than zero. It is assumed that a subject first estimates 
the difference between x. and y. for each dimension, then weights each of these 
difference estimates according to the perceived importance of the i dimension, 
and finally combines the weighted differences in some way to reach a decision. 

From these assumptions Morrison indicates that intransitivities will not 
be predicted unless "...the difference function is a particular type of 
nonline a r function" [p. l 6 ]. While not elaborating on the characteristics of 
this "particular type" he suggests the equation 

d(x,y) = Y(x/y)“ 

from previous psychophysical research involving magnitude estimates of differences 
between stimuli (see Morrison, 1962, p. 16 — 17 for details). While the empirical 
work Morrison describes is rather inconclusive, his assumptions concerning 
estimation of component differences have led to some interesting refinements. 

Such refinements have been predicated upon assumptions, which were first 
articulated by Krantz ( 1967 ) and Tversky and Krantz (1969a) for the case of 



general multidimensional measurement. Their development is concerned with 

empirical judgments of dissimilarity or "psychological distance" by the sub T 

ject. In such a case the basic equation of the model derived is d(x,y) = 
n 

F[E<J>. ( |x. -Y. | ) ] , where d(x,y) is a measure of such a distance. By appro- 

• 1 XI , 

X 

priate specification of the <J>^ and F, it is seen that the power metric or 

Q * | yt 1 /vi 

Minkowski r-metric, d(x,y) = [£|X.-Y. | ] ' , is a special case of this model. 

• X X 
1 

, 1 , 

The well-known Euclidean and city block metrics are obtained as still stronger 

cases, when r = 2 or 1, respectively. 

Tversky (1969) discusses a model for choice behavior based on an applica^ 

tion of the same assumptions which underlie the above distance model. In the 

choice situation, they may be stated as follows: 

i) Decomposability: Let X_,...,X n be non-empty sets, with Yf* a binary 

n 

relation (preference in this case) on X = IE X. . Let f be a real- 

i«l 

valued function of n real variables. Then (X^, , jX n ,'$?) is de- 
composable relative to f if there exist real valued functions <(> , 

,<fc defined on X,X^,... ,X n respectively such that for x = 
(x^... 9 x n ) , y = (y 1 ,...,y n ) eX, x Tr y if and only if f[(j> 1 (x 1 ,y 1 ) , . . . 

♦ (x »y ) ] > o . 

r n n ,,7 n »- 

Assuming that x » (x^,...,x n ) and y =' (y^,...,y n ) are stimuli characterized 
in terms of their components, the decomposability assumption implies that the 
choice between two stimuli is a function of the component-wise (i.e., dimen- 
sional) contributions . The function f gives the rule of combination for 
the contributions from each dimension, while <f>^, . . . ,<f> n specify the appro- 
priate measurement scales. 

ii) Interdimensional additivity: 
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That is, the choice depends on the sum of component -wise contributions across 

the different dimensions . 

iii) Intradimensional subtractivity : 

n — 

x '75- y if an d only if 2 c* 4 > i Cy ± ) J > 0 • 

i 

Here the contribution of any single dimension is some function of the difference 
of scale values for each stimulus on that dimension. Thus, according to this, 
the additive difference model (ADM), choice behavior is described in terms of 
two independent processes, one satisfying intradimensional subtractivity and 
the othe.r satisfying interdimens ional additivity. These can be seen to be the 
formal equivalents of Morrison's assumptions described previously, in which the 

subject first estimates the difference between x ± and y i on each dimension 

(estimates f.U.) - •fc.ty.)), weights each of these difference estimates accord- 
ing to the perceived importance of the i th dimension (applies f^) > and 

n 

finally combines the weighted differences (takes Z), 

Now, consider the special case of the ADM in which all the difference 

functions are linear, i.e., in which f^(<!£) = ? or w ^ ere COIV 

responds to the difference between the subjective values of x and y on the 
i th dimension, ♦.(x.) - ♦ i (y ± ), and t. is some positive constant. In this 

instance, 

Sf 4 [4> n . (x„ ) - ^(y^^)] = 2 t i [<j) i (x i ) - <(> i (y i )J . 



1 T 1 1 



= ?t,<|>. (x.) - ft.<fr i (y i ) 



i 1 T 1 1 



Letting = ^i^i^ x i ) ’ ^ en 



?f i U i (x i ) - 4^)1 = - | v i ( 3 f i ) • 
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But since alternative x is preferred to alternative y when the left hand 
side of the above expression is greater than or equal to zero, then x must be 
preferred to y if and only if 

(j>(x) = Zv. (x. ) > Zv. (y. ) = <j>(y) 
i 1 1 i 

Tversky terms this special case of the ADM just the additive model. Such an 
additive structure has been the subject of detailed discussion by a number of 
other writers (for example, Adams & Fagot, 1959; Krantz, 1964', Luce & Tukey, 
1964; Tversky, 1967b). 

Although the additive model is formally equivalent to the ADM with the 
further restriction that the difference functions are linear, the two models 
have very different psychological implications concerning the way in which 
information about the alternatives is processed in order to reach a decision. 

The additive model implies a process of independent evaluation of each stimulus. 
A subject evaluates alternatives x and y separately, assigns <|>(x) and <(>(y) 
to the respective alternatives, and then makes the choice of x over y if 
and only if <j> (x) > <j>(y) . In contrast the ADM does not imply such a distinct 
evaluation but rather a consideration of the 6^’s, the pairwise differences 
of scale values on each dimension; each such 6^ makes some contribution to 
the overall judgment. Accordingly, Tversky suggests that this contribution, the 
f (6.) in each case, be viewed as the "advantage" or "disadvantage" of x over 

l l 

y (depending on whether 6^^ is positive or negative) with respect to the i 
dimension. The 6 . values are then summed over all n dimensions, and x 
is chosen over y if this sum is greater than zero. 

These two methods of processing alternatives were first distinguished by 
Morrison (1962) and elaborated on by Shepard (1964a) and Tversky (l 969). 
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Schematic ally the difference may be viewed as follows: 



x = (x 1 ,x 2 , 



’V ..,x n )=^|* i (x i ) 



y = (y-^yg, » y n ^^jM y i^ 

U-jMj. (y.^ , . • (x i ) (y A )^^* n U n ) H? n Cy n ) ] . 

The addi tive model leads to what has been termed "horizontal" processing in 
which scale values of the components are summed for each stimulus (=$) and the 



resulting totals compared to arrive at a choice. The ADM suggests "vertical" 
processing in which intradimens ional differences are calculated (4J-) and then 
summed to determine the choice . Since the additive model and the ADM are 
synonymous when all the difference functions are linear, the vertical and _ 
horizontal strategies may yield identical results, though implying different 

s . ■ A, 

v 

ways of processing the stimuli . 

The relationship of the ADM to the problem of transitivity was investigated 
„ by Tversky who proved the following theorem (see 1969, appendix, for details 
of the proof) : 

If the additive difference model is satisfied, then the following 
assertions hold whenever the difference functions are defined: 

1. For n > 3 , transitivity holds if and only if all difference func- 
tions are linear. That is, ^(6) = t ± 6 for some positive t ± and 
all i . 

2. For n = 2, transitivity holds if and only if f^(6) = f 2 (t6) for some 
positive t . 

3. For n = 1, transitivity is - always satisfied. 

Thus, for transitivity to be satisfied by the ADM, v.he difference function must 
take a certain form. For n = 2 (i.e., in the two dimensional case) the 
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difference function for each dimension must be the same except for a change of 
unit. If there are three or more dimensions, the theorem states that linear 
difference functions for each dimension is a necessary and sufficient condition 
for transitivity to hold. Since it has already been shown that when all dif- 
ference functions are linear, the ADM reduces to the special case of the addi- 
tive model, it is this case, and only this one, in which transitivity will be 
satisfied. That is, if any difference function is nonlinear, the transitivity 
assumption will be violated somewhere in the system. 

Now, reconsidering the lexicographic semiorder in the context of the ADM, 
it is evident that the former is just a situation in which one of the difference 
functions is a step function. Tversky (1969) discusses a schematic illustration 
in which three alternatives are scaled on two dimensions as follows: 

.. Dimensions 
I II 

x 2e 6e 

alternatives ; y 3e 

z he 2e 

The alternatives might be job - offers rated on dimensions of pay and rank as 
in an example discussed by Davidson, McKinsey and Suppes (1955), or, as Tversky 
suggests, the alternatives might be individuals applying for a job, rated on 
their intelligence and experience. In either case, suppose that a subject 
decides among a pair of alternatives by selecting the one with the higher value 
on the first dimension, providing that the difference between the members of 
the pair on this dimension is greater than e . If this difference is less than 
or equal to e , he selects the alternative which is scaled higher on the second 
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dimension. This, of course, is equivalent to the step function (f^(6) = 0 when 
6 < e) and results in the following circular set of choices: x preferred to y, 

y preferred to z , and z preferred to x . A decision rule of this type is par- 
ticularly appealing whenever the relevant dimension is noisy due to imperfect 
discrimination or to unreliability of measurements . 

In the empirical investigation of this model, Tversky presented subjects 
with pairs of hypothetical applicants to a college. Each applicant was 
characterized "by a graphic profile displaying percentile ranks on dimensions I 
(intellectual ability), E (emotional stability) and S (social facility). Sub- 
jects were requested to select the preferred applicant from each pair. They 
were instructed that "...intellectual ability would be the most important facr- 
tor in your decision, but the other factors are of some value too. Also, you 
should bear in mind that the scores are based on the (selection) committee's 
ranking and so they may not be perfectly reliable” [1969, p. 37 ] » All 36 
subjects participated in a preliminary session in which they made choices from 
a complete paired comparison schedule constructed from ten stimuli (applicant 
profiles). These stimuli were so chosen that a perfect negative correlation 
existed between scores on dimension I and scores on dimensions E and S. The 
results of this preliminary session were used. to identity those subjects whose 
choice patterns came close to the lexicographic semiorder, i.e., choices made 
on the basis of dimension I until the I difference fell below some (epsilon) 
threshold. In this way. 15 subjects were selected and invited to a test ses- 
sion. Each one was presented with a new set of profiles constructed so that 
the intermediate differences on the I dimension equaled the epsilon threshold 
estimated from the preliminary testing. Predictions derived from the ADM fit 
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the data significantly better than those expected from weak stochastic tran- 
sitivity assumptions . 



2.6 Other Empirical Research 

Luce and Suppes (1965, pp. 380-390) present a review of empirical investiga- 
tions of intransitivity. The great majority of this literature is not relevant 
to the present study for two reasons. First of all many of these studies are 
concerned. with choice under uncertainty— —the subject knows that there is some 
probability, neither zero nor one, that he will actually receive the alterna- 
tive he selects. The present investigation will consider only those cases in 
which the subject receives his choice (or is aware of the consequences of his 
choice) with probability one. Secondly, as Edwards ( 1961 ) has pointed out, 
these papers often 

, . .report experiments in which transitivity seems quite likely to be 
true, find an acceptably low percentage of intransitivities, and, in 
effect, accept the hypotheses they set out to accept. ...It seems 
likely that conditions can be designed in which subjects choose intran- 
sitively most of the time (unpublished research so indicates); it is 
even possible that the direction of intransitive cycles can be con^ 
trolled by experimental manipulation. If so, the question for experi- 
menters to answer is not whether any form of transitivity holds, but 
rather under what circumstances do various assumptions about tran- 
sitivity hold, and under what circumstances do they not [p. ^83]. 

A study by Davis (1958) approached the transitivity problem from a dis- 
tinctly different perspective. Davis began by pointing out that preliminary to 
any discussion of a possible systematic basis for circular triads, there must 
be evidence of their stability over testings: "In none of the studies (which 

Davis reviews) were the same triads presented to the same subjects on two dif- 
ferent occasions. Therefore, the above evidence fails to demonstrate that 
stable circular triads exist" [Davis, p. 29]. 
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Accordingly, Davis undertook two experiments in which the same paired comparir 
son schedules were administered to the same group of subjects on two separate 
occasions. The first experiment utilized stimuli similar to the ones in May's 
study. Forty-seven undergraduate male students were asked to indicate their 
marriage preferences among all possible pairs of nine girls. Each girl was 
described by a verbal rating on three relevant dimensions. For example, A was 
plain, very charming, wealthy; B was pretty, average charm, wealthy, etc. In 
the second experiment paired comparison choices similar to the ones originally 
used in a series of investigations by Edwards (1953, 195^a, ,195^b) were pre- 
sented t o 2b students. Fifteen pairs of bets, each with a zero expected value, 
but differing in amount of money bet and probability of winning were the 
stimuli. In neither case did Davis find significant evidence for the existence 
of stable circular triads. 

I 

2.7 Intransitivity Models and Stable Circular Triads 

Like the Davis study the present research seeks to find evidence for the 
existence of circular triads which will be repeated identically by a subject 
on two administrations of the same set of paired comparisons. Consequently, it 
is of interest to review the models discussed in this chapter specifically with 
respect to such consistent transitivities. The following chart indicates the 
prediction of each of the models listed at the left : 

Model Prediction 

L UC e Choice Axiom Symmetric Intransitive Triads — there will be as 

many circularities repeated in the opposite as 
■ in the original direction. 
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Model 

Coombs — Unfolding Theory 

May, Morrison, Tversky — 
Additive Difference Model 
Savage — Minimax 

Quandt — Consumer Behavior 
Shepard— Attentional Model 



Prediction 

No consistent circularities since this would 
be a violation of weak stochastic transitivity. 
Consistent circularities expected. 

Not applicable to the present situation; only 
to choice under uncertainty. 

Prediction unclear 

Prediction unclear*— if it can be assumed that 
the individual's attention will be focused on 
the same dimension during each testing, con- 
sistent circularities would be expected. 



Morrison and Tversky are subsumed under May since they are more formal state- 
ments of the same model. It is only this model which has a definite expecta- 
tion of consistent circularities. 
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CHAPTER III 



DATA COLLECTION 

3.1 Aims of the Present Study 

This investigation presents a group of subjects the same paired com*- 
parison tasks on two separate occasions. However, both the choice of stimuli 
used in the schedules and the method of analysis were designed to overcome 
certain methodological weaknesses in the Davis study. The principal concerns 
of this study are as follows : 

1) Can evidence be found for the existence of stable (i.e., over test- 
ings) circularities? 

2) If such evidence is found, this work will investigate the appropriate- 
ness of the ADM discussed previously as a fit to these circularities . 

3) If such evidence is not found, then the appropriateness of the 
"intransitivity as inconsistency" viewpoint will be investigated by exploring 
the relationship between circular triads and changes in response to individual 
items between the first and second testings. As a part of this concern, the 
Luce prediction of symmetric intransitive triads will be checked. 

Five paired comparisons schedules were utilized. Each such schedule was 
administered twice to the same group of subjects. 

3.2 The Stimuli 

The first paired comparison schedule, the General Gcals of Life Question- 
naire (Appendix II ), was developed by the Cooperative Study of General Educa*. 
tion. It was selected both because in a previous study (Gulliksen, 1964) sub- 
jects had generated a large number of circular triads in responding to it , and 
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because it has been factor analyzed (Tucker, 1956; Gulliksen, 1964) presenting 
some knowledge of the underlying multidimensional space in which these items 
may be conceptualized by subjects. Each item in this questionnaire presents 
the subject with a pair of possible goals of life, and he is requested to choose 
the one he feels is more desirable. The 12 different Statements of goals yield 
a paired comparison task with 66 choice pairs. 

The second set of stimuli the Payments Questionnaire (Appendix III) was 
constructed specifically for this study. It consists of sets of possible pay- 
ments for participation in psychological research. Each payment consists of 
remuneration of three types: money (5» 10 , or 15 dollars); grade points to be 

added to the subject's semester average (three, six, or nine points); and the 
opportunity to waive some required written reports (one, two, or three reports). 
Each item lists a pair of sets of such payments for the experimental participa- 
tion, and the subject is requested to choose the preferred set. 

This questionnaire was designed to overcome a possible weakness in the 
Davis study. The selection of hypothetical marriage partners as stimuli and 
the accompanying description implicitly assume that individual preference will 
increase with higher ratings on the three dimensions in the description-- looks , 
charm and financial background. Actually many young men might well prefer a 
girl with a lower rating on one of these attributes, especially the one con- 
cerned with financial background. It is certainly a more defensible assump- 
tion that increases in ratings on the stimulus attributes presented here — money, 
grade points , and waived reports— will correspond to increased preference on 
the part of the subjects. 

Since the three different types of remuneration have three degrees or 
amounts each, there are 27 possible stimuli that may be constructed. A complete 
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p aired comparison schedule of these stimuli would involve 27(26 )/2 or 351 judg- 
ments by each subject. Some practice testing with this number of stimuli 
proved to be too demanding on subjects, who generally agreed that after 70 or 
80 such items, concentration became exceedingly difficult. Consequently, in 
order to reduce the amount of subject labor necessary and thereby ensure 
greater concentration, 12 stimuli were selected from the 27, and a paired comr 
parison task of 66 items constructed from these 12 . 

A further reason for the design of the Payments Questionnaire concerns 
the difference between choices in situations in which the dimensionality of the 
underlying Judgment space is inferred through some multivariate procedure such 
as factor analysis , and those in which the relevant dimensions are ‘built into" 
the description of the stimuli. Shepard points out that the former tend .. .to 
be reacted to as homogeneous, unanalyzable wholes .. .while the latter stimuli 
tend to be analyzed in terms of dimensions which are .. .perceptually obvious 
and separable" (1961*, p. 59]. Of the five paired conparison schedules used in 
this study, only the Payments Questionnaire uses stimuli with such "built in" 
attributes. The difference between responses to the two distinct kinds of 
stimuli has been the subject of some discussion (Attneave, 1950; Torgerson, 
1958, 1965; Shepard, 1964b). As Torgerson states in Theory and Methods of 
Scaling ; 

• • .if a subject is required to rate a set of stimulus pairs with re- 
spect to their similarity and the stimuli differ with respect to 
obvious and compelling dimensions , his ratings might very well behave 
as though they vere a straight sum of the differences on the separate 
dimensions. ...On the other hand, if separate dimensions are not 
obvious, the subject might be more likely to judge the overall differ«- 
ence directly [1958, p. 254]. 

While these remarks refer to similarity judgments, the same considerations 
would be relevant to choice behavior. 
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The Occupations Questionnaire (Appendix IV) presents the subject with pairs 
of occupations. In each case the subject is asked to select the occupation 
which is "most looked up to." The 15 different occupations yield a paired com,, 
parison task with 105 choices to be made. This questionnaire was put together 
by selecting 15 of the 31 stimuli used in an earlier occupations questionnaire 
which utilized a multiple rank orders design. Factor analytic results are 
available on this 31 stimuli questionnaire (Gulliksen, 1961*). 

The Offenses Questionnaire (Appendix V) used in this study is an adapta- 
tion of a questionnaire designed by Thurstone (l927b). Of the 19 stimuli in 
the Thurstone work, eight were selected to produce a paired comparison task 
with 28 items. Each item presents the subject with a pair of criminal offenses, 
and he must choose which of the pair would cause him the greater shame. 

Finally, the Vietnam Questionnaire (Appendix VI ) was put together utilize 
ing some statements from previous research on attitudes towards Vietnam 
(Pargament, 1968), some from Thurstone* s scale of Attitudes towards War (Peterson, 
1931), and same written specifically for this questionnaire. The statements are 
presented to the subject in pairs, and the subject is asked to choose which of 
the pair better represents his own opinion. There are 15 statements producing 
a paired comparison task with 105 items. The first four questionnaires all 
concern choices about topics on which subjects are very unlikely to have well 
rehearsed positions . This questionnaire was constructed to see if choices on 
an issue of current concern to— it is safe to assume— all subjects will produce 
a greater number of intransitivities. 
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3.3 Subjects 

The subjects for the Goals of Life Questionnaire were 74 undergraduate stu- 
dents from two courses (introductory psychology and social psychology) at Bates 
College, Lewiston, Maine. Subjects for the Payments, Occupations and Offenses 
Questionnaires were 45 undergraduate students from Rutgers University College, 
Camden, New Jersey. The grading system there is the one, two, three, four, five 
type, corresponding to 90-100 , 80-89 , 70-79 , 60-69 and below 60, respectively. 
Thus the three, six, or nine grade points as a part of their payment in the 
Payments Questionnaire would be relevant to them. Subjects for the Vietnam 
Questionnaire were 20 more undergraduate students from Rutgers University 
College at Camden. 

3.4 Procedure 

Each subject completed the assigned paired comparison task(s) during a 
regular class period. One week later the study was repeated with the same stur 
dents and the same stimuli. On both occasions the subjects were requested to 
put their student ID number, or license number, etc. on the top of the instruct 
tion page of each questionnaire for identification purposes (i.e., in order to 
match the questionnaires from separate testings without identifying individuals 
with opinions). On all tasks subjects took considerable time and seemed to be 
making decisions carefully. 
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CHAPTER IV 



DATA ANALYSIS 



The data in the Davis study, collected by the same method utilized here. 



were presented in a 2 x 2 table in which the row classification was the fre^ 
quency of circular and transitive triads during the first presentation, while 
the column classification was the same frequency count for the second pre- 



sentation of the stimuli. Thus the four cells represented triads which were 
circular both times, triads which were transitive both times, triads which 
were circular the first time and transitive the second, and triads which were 
transitive the first time and circular the second. 



The present study malces a more detailed analysis of subjects' responses 
than was possible in Davis 's precomputer investigation. There are eight 
possible configurations of responses to each possible triad. For stimuli I, 
J, end K (and using > to stand for "is chosen over"), these would be as 

follows : 



1 . 



2 . 



3 . 



k. 



5 . 



6 . 



7 . 



8 . 



K > J, J>I, K > I 
J > K, J > I, K > I 

J>I, J > K, I > K 

K > I, I>J, K > J 
I > K, K > J, I>J 

I > J, J > K, I>K 

J > I, I > K , K > J 

I>J, K > I, J > K 



The first; six possibilities are transitive , while the 7th and 8th are circular 
triads . 
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4.1 Stable Circularities 

A computer program was written which creates an 8 x 8 matrix for every sub- 

i 

ject. The row subscript in each matrix corresponds to the configuration (of J 

the eight listed above) used by the subject for a given triad on the first j 

testing, while the column subscript corresponds to the configuration for the 
same triad on the second testing. Thus each of the 64 cells contains a fre<- , 

quency count— the number of triads that were chosen as designated by the row j 

and col umn - This analysis was performed over all possible triads for each 
questionnaire. Since there are n(n — l) (n - 2)/6 possible triads formed from n i 
original stimuli, the total number of triads investigated for each questionnaire 
(i.e., the sum of the frequencies in the 64 cells) is as follows: 



Quest ionnai re 


No. of Stimuli 


No. of Triads 


Goals of Life 


12 


220 


Payments 


12 


220 


Occupations 


15 


455 


Offenses 


8 


56 


Vietnam 


15 


455 



The diagonal cells naturally contain the frequencies of triads to which 
the subject responded exactly the same on both testings . Since the 7th and 8th 
rows and columns represent the two circular configurations, stable intransi— 
tivities would be indicated by sizable entries in the (7*7) ond (8»8) cells of 
these matrices . 

With one exception (to be discussed later) no such sizable entries in the 
7th and 8th diagonal cells were found. Tables la, lb, lc. Id and le present 
the matrices of totals (over subjects) for the Goals of Life, Occupations, 
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Offenses, Vietnam and Payments Questionnaires, respectively. Table la shows 
that there was a total of 41 (.13 + 28) stable intransitivities for the Goals 
of Life Questionnaire, but this total is due to the responses of a number of 
subjects , no single one of whom produced more than six such stable circulari- 
ties. Tables lb, lc and Id show that similar totals over subjects were 
4 (3+1) for the Occupations Questionnaire, 3 (2 + l) for the Offenses 
Questionnaire and 7 (4 + 3) for the Vietnam Questionnaire. 

As shown in Table le, there were 67 (39 + 28) stable circular triads pro*, 
duced by subjects on the Payments Questionnaire. However, 53 of these came 
from subject number 4?, whose matrix of responses is presented in Table 2. 

It is interesting that this subject has no frequencies whatsoever in the off- 
diagonal cells, indicating that his choices were exactly the same on both 
testings . Disregarding the responses from this subject leaves a total of only 
14 stable circular triads produced by the. other subjects. Thus, with the excep- 
tion of a single subject on the Payments Questionnaire, none of the stimuli 
used in this study have presented evidence of stable intransitivities- 

4 . 2 The Luce Prediction 

The Luce model implies that there will be symmetric intransitive triads. 
That is , there should be equal frequencies of triads which are circular in the 
same direction ovsr the tv T o testings and triads which are circular in opposite 
directions over the testings. Thus the specific prediction of the Luce model 
for the data presented here is that the sum of the (7,8) and (8,7) cells should 

be equal to the sum of the (7»T) and (8,8) cells. 

Table 3 presents the results for each questionnaire of chi square tests of 
this prediction. These are oner-tailed tests; the alternative to the null 
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Table la 

Matrix of Totals for Goals of Life Questionnaire 





1 


2 


3 


4 


5 


6 


7 


8 


1 


3186 


692 


92 


415 


63 


26 


59 


50 


2 


6o4 


2320 


353 


63 


29 


67 


33 


40 


3 


59 


359 


1079 


21 


42 


284 


38 


27 


4 


503 


68 


35 


1189 


343 


44 


34 


47 


5 


80 


23 


4l 


242 


1258 


231 


29 


22 


6 


27 


63 


254 


32 


225 


993 


12 


33 


7 


58 


40 


26 


20 


34 


30 


13 


10 


8 


25 


40 


28 


33 


21 


26 


9 


28 








Table 


lb 












Matrix 


of Totals 


i for Occupations Questionnaire 








1 


2 


3 


4 


5 


6 


7 


8 


1 


2917 


283 


22 


387 


26 


7 


9 


3 


2 


269 


1817 


289 


32 


13 


17 


3 


5 


3 


18 


238 


2397 


7 


33 


271 


12 


2 


4 


396 


7 


9 


4224 


332 


26 


7 


12 


5 


29 


1C 


26 


493 


2726 


347 


11 


4 


6 


3 


22 


305 


14 


316 


1904 


5 


4 


7 


21 


11 


14 


25 


22 


8 


3 


1 


8 


4 


9 


9 


12 


12 


13 


1 


1 
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Table lc 



Matrix of Totals for Offenses Questionnaire 





1 


2 


3 


4 


5 


6 


7 


8 


1 


200 


49 


3 


64 


12 


11 


3 


3 


2 


28 


203 


64 


13 


12 


16 


2 


1 


3 


13 


54 


323 


15 


l6 


53 


7 


1 


4 


47 


11 


4 


268 


60 


17 


1 


4 


5 


6 


15 


10 


42 


254 


60 


6 


4 


6 


8 


7 


50 


10 


69 


337 


2 


2 


7 


4 


3 


5 


4 


11 


5 


2 


0 


8 


0 


0 


3 


11 


4 


6 


1 


1 



Table Id 

Matrix of Totals for Vietnam Questionnaire 





1 


2 


3 


4 


5 


6 


7 


8 


1 


950 


185 


19 


171 


15 


12 


l4 


12 


2 


229 


1392 


280 


11 


6 


25 


8 


12 


3 


24 


230 


928 


12 


22 


180 


16 


5 


4 


182 


13 


12 


804 


152 


24 


11 


12 


5 


20 


6 


12 


140 


946 


214 


12 


8 


6 


11 


25 


173 


30 


246 


1092 


9 . 


15 


7 


15 


6 


13 


8 


8 


li 


3 


2 


8. 


9 


25 


18 


17 


8 


25 


1 


4 
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Table le 

Matrix of Totals for Payments Questionnaire 





1 


2 


3 


4 


5 


6 


7 


1 


1656 


250 


26 


232 


35 


5 


30 


2 


202 


1064 


158 


29 


3 


13 


18 


3 


24 


125 


1148 


7 


12 


81 


15 


4 


224 


29 


4 


1136 


227 


10 


25 


5 


23 


8 


9 


183 


1499 


83 


17 


6 


7 


19 


83 


9 


98 


671 


10 


7 


25 


20 


21 


25 


30 


9 


39 


8 


12 


18 


14 


18 


13 


24 


4 
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18 

10 

23 

13 

8 

7 

28 
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Table 2 

Triad Matrix for Subject Hk2 on Payments Questionnaire 



1 

2 

3 

4 

5 

6 

7 

8 



1 

40 

0 

0 

0 

0 

0 

0 

0 



2 

0 

36 

0 

0 

0 

0 

0 

0 



3 

0 

0 

24 

0 

0 

0 

0 

0 



4 

0 

0 

0 

31 

0 

0 

0 

0 



5 

0 

0 

0 

0 

27 

0 

0 

0 



6 

0 

0 

0 

0 

0 

9 

0 

0 



7 

0 

0 

0 

0 

0 

0 

32 

0 



8 

0 

0 

0 

0 

0 

0 

0 

21 
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hypothesis of equivalence between the diagonal and nondiagonal pairs of cells 
is the hypothesis that there is a greater frequency of stable intransitivities. 
The test on the data from the Payments Questionnaire excludes subject k2 who 
conclusively yielded stable circularities. Only one of these tests is sig- 
nificant, while two are not significant and two have frequencies too small to 
submit to statistical test. However, all five show a greater frequency of 
repeated circular triads than reversed ones . 

Table 3 

Test of Luce’s Symmetric Intransitive Triads Prediction 

H fi : sum of the (7,7) and (8,8) cells is equal to the sum of the (7,8) and 

(8,7) cells vs. 

H : sum of the (7»7) and (8,8) cells is greater than the Siam of the (7,8) and 

1 (8,7) cells. 



Obs Freq Ex Freq 



Questionnaire 


DiagPr 


OffdiagPr 


DiagPr 


OffdiagPr 


Chi Sq 


Si£ 


Goals of Life 


Ul 


19 


30 


30 


8.07 


.005 


Payments 


lit* 


' 11* 


12.5 


12.5 


.36 


n.s , 


Occupations** 


It 


2 










Offenses** 


3 


1 










Vietnam 


7 


3 


5 


5 


1.6 


n.s . 



^Excludes subject #1*2 

^Frequencies not large enough for chi square test 
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lt.3 Intransitivity and Inconsistency — the Factor Analysis 

The lack of evidence for stable circularities leaves the still significant 
problem of accounting for a large number of circular responses by subjects. If 
the assumption that intransitivity is synonymous with inconsistency is to be 
tenable, then total circular triads is essentially the same as number of re- 
versals, or mean separation for reversals, or some similar variable. That is, 
the inconsistency explanation for circular choices implies that essentially 
the same information is derived from a single administration and total circular 
triads, as from the inconsistencies over two administrations. 

In order to investigate this , the kind of change which takes place in the 
actual paired comparison choices for each off-diagonal cell was considered. 

Such changes may be characterized both by number and type. By number is meant 
whether one, two or three changes take place in the responses to the three 
pairs which comprise the triad. For example, if a subject's response to a 
triad during the first testing is I>J,J>K,I>K, and during the second 
testing, it becomes J > I, J > K, I > K , one change (in the I-J comparison) 
has taken place. Two or three changes may occur similarly. By type is meant 
whether the change involves an adjacent or extreme pair of stimuli in the re- 
sponse to the triad on the first testing. In the example given above, I-K is 
a pairing of the extreme stimuli for this triad, while Ic-K and J-K are pairs 
of adjacent stimuli. It is a change in response to the extreme stimuli that 
produces circularity; a change of response to adjacent stimuli results in a 
new ordering, but one that remains transitive. Table ^ presents the changes 
which produce each of the off-diagonal cells. 





Table 4 

Number and Type of Stimulus Changes 





1 


2 


3 


b 


5 


6 


7 


8 


1 


0 


1AD 


2AD 


1AD 


2AD 


3 


1EX 


2EX 


2 


1AD 


0 


1AD 


2AD 


3 


2AD 


2EX 


1EX 


3 


2AD 


1AD 


0 


3 


* 2AD 


1AD 


1EX 


2EX 


b 


1AD 


2AD 


■3 


0 


1AD 


2AD 


2EX 


1EX 


5 


2AD 


3 


2AD 


1AD 


0 


1AD 


1EX 


2EX 


6 


3 


2AD 


1AD 


2AD 


1AD 


0 


2EX 


1EX 


7 


1EX 


2EX 


1EX 


2EX 


1EX 


2EX 


0 


3 


8 


2EX 


1EX 


2EX 


1EX 


2EX 


1EX 


3 


0 




1, 2 or 


3 denotes 


the 


number of 


changes 









AD denotes adjacent stimuli 
EX denotes extreme stimuli 

Thus each subject could be given a score on each of the following variables 
DIAG - sum of the frequencies in the first six diagonal cells; this is 

the number of triads which are transitive in exactly the same way 
each time. 

REPCIR - sum of the frequencies in the 7th and 8th diagonal cells; the 
repeated circularities . 

CIR - sum of the frequencies in the two cells which are circular on 
each testing in a different direction. 

ADI - sum of the frequencies in the 12 1AD* cells ; transitive triads 
with one change in individual items. 

* i \ 

See Table 4 
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AD2 - sum of the frequencies in the 12 2AD# ceils ; transitive triads with 
two changes in individual items. 

3C - sum of the frequencies in the six (transitive) cells with three 
changes. 

EX1 - sum of the frequencies in the 12 1EX* cells; triads which are tran- 
sitive on one testing and circular on the other with one change in 
individual items. 

EX2 - sum of the frequencies in the 12 2EX* cells; triads which are tran- 
sitive on one testing and circular on the other with two changes in 
individual items . 

Scores on the following variables for each subject were also added to the 
score set described above: 

TCT1 - number of total circular triads on the first administration. 

TCT2 - number of total circular triads on the second administration. 

REV - number of reversals of individual items from the first to the 
second testing. 

MDR1 - the mean difference in votes on the first testing between members 
of the pair on items which were reversed. 

MDR2 - the mean difference in votes on the second testing between members 
of the pair on items which were reversed. 

Thus, there are a total of 13 measures for each subject. However, a num- 
ber of linear dependencies exist between these variables and consequently, some 
were dropped from the analysis. Specifically, TCT1, TCT2, REPCIR and CIR con- 
tain duplicated information, and the latter two variables were deleted. Also, 



* 

See Table 
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variable 3C was dropped due to very low frequencies in these six cells. Finally, ,f 
variables EX1 and EX2 were collapsed into one measure, EX, the number of triads 
which were circular on one cf the testings and transitive on the other. This 
was done since previously unpublished research (Tucker, 1969) shows no sig- 
nificant differences in the frequencies in these two groups of cells. The 
above changes resulted in nine variables for each subject on each of five ques- 
tionnaires . 

The correlation matrices for each of these five sets of variables were 
formed. Since DIAG is the only measure for which large values indicate 
greater transitivity-consistency (i.e., the other variables are all measures of 
intransitivity and/or inconsistency), scores on the other eight variables were 
given negative signs. Consequently, higher values on all variables are indica- 
tive of greater transitivity or consistency. The correlation matrices are 
presented in Tables 5a, 5b, 5c, 5d and 5e. 
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Table 5 a 

Correlation Matrix for Vietnam Data 



1 


TCT1 


TCT2 


REV 


MDR1 


MDR2 


DIAG 


ADI 


AD2 


TCT1 


1.000 


.372 


.470 


.434 


.812 


.493 


.353 


.479 


TCT2 


.372 


1.000 


.796 


.893 


.401 


.772 


.615 


.835 


REV 


.U70 


.796 


1.000 


.807 


.578 


.996 


.949 


.932 


MDR1 


.434 


.893 


.807 


1.000 


.568 


.790 


.647 


.879 


MDR2 


.812 


.401 


.578 


co 

VO 
1 f\ 
• 


1.000 


.582 


.447 


.692 


DIAG 


.493 


.772 


.996 


.790 


.582 


1.000 


.963 


.917 


ADI 


.353 


.615 


.949 


.647 


.447 


.963 


1.000 


.805 


AD2 


.479 


.835 


.932 


.879 


.692 


.917 


.805 


1.000 


EX 


.778 


.857 


.829 


.840 


.701 


.827 


.666 


.844 










Table 5b 












Correlation Matrix for Occupations Data 








TCT1 


TCT2 


REV 


MDR1 


MDR2 


DIAG 


ADI 


AD2 


TCT1 


1.000 


.338 


.829 


.393 


.635 


.795 


.675 


.835 


TCT2 


.338 


1.000 


.308 


.185 


.055 


.335 


.314 


.127 


REV 


.829 


.308 


1.000 


.292 


.763 


.992 


.946 


.911 


MDR1 


.393 


.185 


.292 


1.000 


.296 


.245 


.135 


.421 


MDR2 


.635 


.055 


.763 


.296 


1.000 


.746 


.691 


.782 


DIAG 


.795 


.335 


.992 


.245 


.746 


1.000 


.977 


.859 


ADI. 


.6 75 


.3lU 


.946 


.135 


.691 


.977 


1.000 


.746 


I AD2 


.835 


.127 


.911 


.421 


.782 


.859 


.746 


1.000 


EX 


.945 


.610 


.814 


.372 


.558 


.797 


.694 


.755 


0 
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EX 

.778 

'.857 

.829 

.840 

.701 

.827 

.666 

.844 

1.000 



EX 

.945 

.610 

.8l4 

.372 

.558 

.797 

.6914 

.755 

1.000 



-52- 



} 
j 

i 

I 

j 

Table 5c 

Correlation Matrix for Offenses Data 





TCTl 


TCT2 


REV 


MDR1 


MDR2 


DIAG 


ADI 


AD2 


E 


TCTl 


• 

1.000 


.1*1*5 


.1*79 


.300 


.630 


.519 


.126 


.1*75 


.9 


TCT2 


.1*1*5 


1.000 


.351 


.308 


.106 


.1*25 


.2 20 


.256 


.7 


REV 


.U79 


.351 


1.000 


.738 


.721* 


.932 


.319 


.921* 


.5 


MDR1 


.300 


.308 


.738 


1.000 


.67U 


.783 


.1*61 


.733 


.3 


MDR2 


.630 


.106 


.721* 


.67I* 


1.000 


.769 


.1*03 


.733 


.5 


DIAG 


.519 


.1*25 


.932 


.783 


.769 


1,000 


.621* 


.823 


.5 


ADI 


.126 


.220 


.319 


.1*61 


.1*03 


.621* 


1.000 


.11*1* 


• £ ! 


AD2 


AT 5 


.256 


.921* 


.733 


.733 


.823 


.11*1* 


1.000 


c 
• ✓ 


EX 


.901 


.752 


.5Ul 


.399 


.506 


.599 


.203 


.502 


l.C 



Table 5d 

Correlation Matrix for Goals of Life Data 





TCTl 


TCT2 


REV 


MDR1 


TCTl 


1.000 


.510 


.561 


.185 


TCT2 


.510 


1.000 


.711 


.616 


REV 


.561 


.711 


1.000 


.688 


MDR1 


.185 


.616 


.688 


1.000 


MDR2 


.399 


.151* 


.582 


.591* 


DIAG 


.51*7 


.652 


.975 


.682 


ADI 


.131 


.091* 


.593 


.383 


AD2 


.l*lU 


.629 


.930 


.755 


EX 


.791 


.907 


.796 


.561 



MDR2 


DIAG 


ADI 


AD2 


] 


.399 


.5U7 


.131 


.1*11* 




.151* 


.652 


.091* 


.629 


# < 


.582 


.975 


.593 


.930 


* 


.591* 


.682 


.383 


.755 


% 


1.000 


.592 


.1*33 


.651 




.592 


1.000 


.737 


.871 




.1*33 


.737 


1.000 


.1*1*9 


•* 


.651 


.871 


.1*1*9 


1.000 




.356 


.752 


.192 


.676 


1.* 
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Table 5e 

Correlation Matrix for Payments Data 





TCT1 


TCT2 


REV 


MDR1 


TCT1 


1.000 


.707 


.620 


.002 


TCT2 


.707 


1.000 


.68* 


vo 

cn 

CM 

• 


REV 


O 

CM 

VO 

• 


.684 


1.000 


.193 


MDR1 


.002 


.236 


.193 


1.000 


MDR2 


.219 


.151 


.333 


.822 


DIAG 


.702 


• 715 


.980 


.173 


ADI 


.*76 


VO 

CO 

-=t 

• 


.93* 


.158 


AD2 


.65* 


.710 


.956 


.169 


EX 


.703 


.775 


.891 


.293 



MDR2 


DIAG 


ADI 


AD2 


EX 


.219 


.702 


.*76 


.65* 


.703 


.151 


.715 


.*86 


.710 


.775 


.333 


.980 


.93* 


.956 


.891 


.822 


.173 


.158 


.169 


.293 


1.000 


.325 


.318 


.327 


.*09 


.325 


1.000 


.9*3 


.921 


.86* 


.318 


.9*3 


1.000 


.816 


.725 


.327- 


.921 


.816 


1.000 


.888 


.*09 


.864 


.725 


.888 


1.000 
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Each correlation matrix was now factor analyzed, and a promax (oblique) 
rotation performed where applicable. For the data from two questipnnaires , 

( occupations and Vietnam, one significant factor was extracted. The factor 
loadings in these two cases are shown in- Tables 6 and 7, respectively. 



Table 6 

Factor Loadings for the Vietnam Data 





I 

T“ 


Communal! ty 


TCT1 


.585 


.342 


TCT2 


.831 


.691 


REV 


.964 


.929 


MDR1 


.875 


.766 


MDR2 


.672 ; 


.452 


DIAG 


.959 1 


.920 


ADI 


.818 


.669 


AD2 


.963 


.927 


EX 


.934 


.872 



Table 7 

Factor Loadings for the Occupations Data 





I 


Communality 


TCT1 


.887 


.787 


TCT2 


.341 


.116 


REV 


.991 


.982 


MDR1 


.346 


.120 


MDR2 


.749 


.561 


DIAG 


.971 


.943 


ADI 


.872 


.760 


AD2 


.906 


.821 


EX 


.878 


.771 
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If, in fact, the tendency to produce circular triads is closely related 
to inconsistency in choice behavior, then, in each case, sizable loadings would 
be expected from both the measures of consistency and transitivity. Inspection 
of Tables 6 and 7 show that this is the case. Those variables which are meas- 

V 

ures of consistency— ADI, AD2 , REV and DIAG— all show loadings well above .80 
for both sets of data, and the order ADI < AD2 < REV and DIAG, as expected, is 
maintained for each analysis. The measures of transitivity— TCT1 , TCT2 and 
EX — show moderate to large loadings; for each set of data two of these three 
measures are well above .80. Furthermore, the fact that MDR1 and MDR2 also 
have moderate size loadings imply that the tendency to be inconsistent in making 
choices is related to the tendency to reverse items with large differences between 
the number of votes for each member of the pair • In sum, these loadings 
indicate that assuming intransitivity to be basically synonymous with 
inconsistency is defensible for the stimuli in the Vietnam and Occupations 
Questionnaires . 

Each of the other three sets of data yielded two significant factors. 

Tables 8a and 8b, 9a and 9b, and 10a and 10b present the factor loadings and 
correlations of the factors for the goals of life, offenses and payments data, 
respectively. 

For the goals of life and the offenses data, the first factor obviously 
represents consistency over testings with large loadings on REV, DIAG, ADI and 
AD2 . Again the expected ordering of ADI < AD2 < REV and DIAG was found. Also, 
sizable loadings on this factor from MDR1 and MDR2 again signify the relation 
stated above between consistency and the magnitude of the difference between 
votes on reversed items . However, in these two cases , large loadings on the 
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Table 8a 

Factor Loadings for the Goals of Life Data 





I 


II 


Communality 


TCTl 


.339 


.511 


.488 


TCT2 


.400 


.716 


.822 


REV 


.891 


.230 


.970 


MDR1 


.701 


.104 


.555 


MDR2 


.688 


-.118 


.473 


DIAG 


.940 


.117 


.981 


ADI 


.728 


-.358 


.576 


AD2 


.853 


.148 


.834 


EX 


.493 


.758 


.997 



Table 8b 

Correlations Between Factors for the Goals of Life Data 





I • 


II 


I 


1.000 


.202 


II 


.202 


1.000 
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Table 9a 

Factor Loadings for the Offenses Data 





I 


II 


Communal ity 






1 




TCT1 


.315 


.690 

0 


.731 


TCT2 


.157 


.6 00 


.1*61 


REV 


.890 


ON 

O 

• 


.872 


MDR1 


.821 


1 

• 

O 

ON 

^3 


.695 


MDR2 


.773 


.069 


.672 


DIAG 


.925 


.087 


.969 


ADI 


Ml 


-.035 


.201 


AD2 


.838 


.030 


.763 


EX 


.307 


.860 


.966 






Table 9b 






Correlations Between 


Factors for the 


Offenses Data 



I 

I 1 . 000 

II -251 



II 

.251 

1.000 




4 
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Table 10a 





Factor Loadings 


for the Payments 


Data 




T 


II 


Communality 










TCT1 . 


.709 


-.094 

* 


.511 


; TCT2 


.725 


-.011 


.558 


REV 


.951 


.001 


.966 


MDR1 


-.034 


.898 


.846 


MDR2 


.118 


.837 


.817 


DIAG 


.967 


-.024 


.985 


ADI 


.809 


.014 


.705 


AD2 


.923 


-.008 


.907 


EX 


.866 


.113 


.868 





Table 10b 




Correlations Between 


Factors for the Payments Data 




I 


II 


I 


1.000 


.253 


II 


.253 


1.000 



j 




( 

f 



i 
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variables measuring transitivity are not found. Instead, the second factor for 
both the goals of life and the offenses data is defined by the three transitivity 
measures — TCT1, TCT2 and EX. Thus, in these two instances, transitivity and 
consistency are represented by different (though slightly correlated) factors, 
and the assumption that intransitivity and inconsistency are synonymous is not 
tenable . 

The factor analysis for the payments data presents a completely different 
situation. Here the first factor is similar to the single factors found for 
the Vietnam and occupations data in that all the measures of transitivity and 
consistency load highly on it, and consequently , the intransitivity-ihconsistency 
assumption is justifiable. However, instead of finding the usual relation 
between this factor and MDR1 and MDR2 , a separate factor is defined by these 
two variables . 

Thus in three of the five cases studied the factor analysis of the ques- 
tionnaires provides support for the hypothesis that circular choices can be 
eq ua ted with reversed responses. Moreover, in two of these three supporting 
cases a greater degree of transitivity-consistency was found to be related to 
small average differences between votes for the members of pairs that were 
reversed over the two testings . 
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CHAPTER V 



DISCUSSION AND CONCLUSIONS 



5 .1 Discussion 

Except for one subject on one questionnaire, this study has found no 
evidence for the existence of circularities which remain stable over different 
administrations of the same pair comparisons task to the same individuals. A 
closer inspection of the responses of the one subject who did produce stable 
intransitivities reveals that this subject was actually choosing for each item 
the member of the pair which presented the "higher" payment on the greater 
number of dimensions . In other words this individual ignored the size of the 
difference and responded on the basis of the number of dimensions on which one 
stimulus was preferable to the other. In terms of the additive difference 
model this corresponds to a step function on each dimension for any difference 
between the stimuli on that dimension. That is, in making his choice, the 
subject is sensitive only to the fact that a difference exists, and not how 
great the difference is. 

Although this is the only instance the author can find of deliberate and 
systematic intransitive choice behavior, th^ra are other reported choice 
processes which might lead to intransitivities. Tversky and Krantz (1969b) de- 
scribe a study in which the stimuli were schematic faces composed of three 
features (i.e., dimensions) each of which could appear in one of two ways. 

Thus the overall shape of the face could be wide or long; the eyes were circles 
which could be empty or blacked in; and the mouth was either straight or 
smiling. The combination of these three binary features resulted in eight 
schematic faces. Subjects were presented with pairs of these faces and asked 
to rate the dissimilarity of each pair from one (least) to 20 (most). Tversky 

erjc *70 
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and Krantz report that one subject merely "...counted the number of dimensions 
on which the faces were different, responding seven, l4 or 20 according to 
whether there were differences on one, two or three dimensions" [1969b, p. 126], 
This is the kind of process which might lead to intransitive choices, if a dif- 
ferent kind of judgment were requested and if there were more than two values 
on each dimension. The essential similarity in the choice mechanism of the 
Tversky and Krantz subject and the intransitive subject in this study is obvious. 
Another example occurs in the Shepard study described previously in which subr- 
jects had to make judgments about geometric stimuli characterized by the size 
of the circle and the angle of the spoke. The "switching" of attention from 
one dimension to another is again a choice process which could result in 
circularity. 

The interesting point concerning the three examples cited above — the sub- 
ject in this experiment, the subject in the Tversky and Krantz study, and the 
"switching" subjects in the Shepard work — is that they were all responding to 
stimuli with "obvious and compelling" dimensions, as opposed to stimuli in 
which the dimensionality depends on subjective evaluation. As Shepard (l964b) 
has pointed out, "...of course, instead of a simple dichotomy here, there may 
actually exist a graded s eries . . .but , in any case, the extreme types can 
readily be recognized" [p. 80], The implication of these examples is undeni- 
ably that stimuli on the perceptually obvious extreme are far more likely to 
evoke intransitive choice behavior that is, in some sense, systematic. 

The lack of stable circularities implies that neither May, Morrison or 
Tversky's model is applicable to the stimuli used in these questionnaires. 
However, none of the stimuli here are the type that would provide a fair test 
for the Tversky model— these data were collected prior to its publication. 
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Aside from the single case discussed above, systematic intransitivity can 
be ruled out for the remainder of the subjects in this research. Yet there 
are large numbers of intransitive triads . The Luce expectation of symmetry of 
direction among triads chosen intransitively on both occasions is statistically 
rejected on only one questionnaire. However, the fact that all questionnaires 
have greater numbers of stable than unstable circularities makes the Luce 
prediction somewhat unconvincing . 

It is very difficult to assess the applicability of Shepard's model. It 
would be necessary to ascertain not only the individual's subjective dimensions 
and his ordering of the alternatives with respect to each dimension, but also 
the conditions under which attention would be focused on one dimension rather 
than another. 

The explanation of intransitivity as essentially synonymous with incon- 
sistency was investigated by means of the factor analysis. Nine variables 
were computed for each subject; seven of these were measures of consistency 
or transitivity, while two--MDRl and MDR2--may be considered measures of 
discrimination among stimuli on the part of the subjects . 

For two of the questionnaires , Vietnam and occupations , this explanation 
was found to be justified. Loadings on the single factor obtained in each 
case tended to identify ihtransitivity with inconsistency. This would suggest 
that for. these questionnaires similar information is derived from the total 
circular triads in one administration as knowledge about the reversals in two 
testings . 

For two other questionnaires, goals of life and offenses, distinct factors 
were identified for transitivity and consistency. The significant question 
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concerns the differences between the type of stimuli resulting in a single 
factor and the type resulting in twc factors. At this point oniy speculation 
can be offered on this question. Considering the questionnaires used here, 
the most noticeable difference seems to lie in the saliency of the stimuli 
for college students . Both their opinions on Vietnam and their judgments of 
the ratings of occupations would seem to be topics to which students have 
probably given considerable thought, and thus have well-rehearsed positions. 

In contrast, their feelings about the proper goals of life and the severity 
of certain offenses figure to be areas about which they do not have such well- 
rehearsed positions . (The previous two statements are, of course, the author's 
speculation based upon extensive, though unsystematic, experiences with and 
observations of contemporary college students,) For these latter stimuli, 
there is a much greater probability that subjects might undergo a real change 

i 

in their opinions between the two administrations of the same questionnaire. 
Consequently, reversals and circularities would not be related to as great 
a degree as for the former stimuli . 

For the payments data, the intransitivity -inconsistency explanation again 
seemed to be upheld as the variables measuring transitivity and those measuring 
consistency loaded highly on the same factor. However, the payments data 

i 

eodiibited an unusual feature. For the other four sets of data, the measures 
of discrimination — MDR1 and MDR2 — loaded in such a way that subjects with 
finer discrimination (i.e., smaller mean differences between votes on members 
of reversed pairs) tended to show greater consistency. The s.ame variables 
?' on the payments data showed almost no loading on the transitivity-consistency 

factor. In other words there seemed to be no relationship between the fineness 
i 

i. 
t 

v‘ 

O 
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of the subject's discrimination and the degree of consistency he displayed. 

In fact, the second factor in the payments data, defined solely by MDR1 and 
MDR2, derives from the fact that these two variables showed a high correla- 
tion with each other (.822 from Table 5e) and low correlations with all the 
other variables. Again the significant problem concerns why this occurred 
specifically on the payments questionnaire, the only stimuli with definitely 
stated dimensionality , At present no obvious rationale for this result can 

be offered. 

The present investigation suggests that further research on intransi- 
tivity might explore a number of possibilities. In addition to the type of 
stimuli chosen, the method of display is another factor deserving attention. 

A comparison might be made between the type of decision process subjects are 
utilizing when the stimuli are presented in a graphic profile (as in the 
Tversky study on choices between college applicants) and when the stimuli 
are presented as a set of numerical values on the different dimensions. 

Also, subjects might be asked not Just to select one of the two alternatives 
in each case, but to make a graded response indicating how much one alter- 
native exceeds the other (in brightness, severity, preferableness, etc.), 
in any event , the clearest implication of the present work for future research 
is that the most interesting stimuli for the study of intransitivity seem to 
be those, like the payments questionnaire, whose dimensions tend to be 

obvious and separable. 

5 .2 Summary and Conclusions 

Five paired comparisons questionnaires were administered on two separate 
occasions. In each case the subjects for the second administration were the 
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same individuals who had completed the particular questionnaire the first 
time, so that data could be obtained on the responses of the same subject to 
the same paired comparisons tasks on two distinct administrations , The 
principal concerns were the following; 

1) To find evidence for the existence of stable (i.e., over testings) 
circular triads. 

2) To investigate the appropriateness of the additive difference model 
if such stable circularities are found, 

3) If such evidence is not found, to investigate the intransitivity- 
as-inconsistency explanation by exploring the relationship between 
circular triads and changes in response to individual items over 
administrations . 

With the exception of one subject on one questionnaire, no such evidence 
for stable intransitivities was found. 

Accordingly, interest was then focused upon the assumption that inLransir* 
tive choice behavior is basically the same as inconsistent choice behavior. 
Specifically, this view holds that one administration of a questionnaire and 
total circular triads is no different than two administrations and the number 
of reversals. This assumption was investigated by a factor analysis of nine 
variables derived from the subjects' choices . These variables were measures 
of consistency, transitivity and discrimination among stimuli. Results of 
this analysis suggest that the assumption of circular choices as synonymous 
with inconsistency is upheld for three of the five questionnaires , 
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Computation of Total Circular Triads 

Consider the paired comparisons votes matrix. Both the rows and the 
column correspond to the individual stimuli. In each cell there is a "one" 
if the row stimulus was chosen over the column, or a "zero" if the column 
stimul us was chosen over the row . 

Now, if a subject's paired comparison choices are all transitive — 
there is no triad configured intransitively— ''then the column totals of 
this matrix will be the integers from 0 to n - 1, where n is the total 
number of stimuli. Also, when all triads are transitive, the sum of 
squares of the column totals is a maximum. Every circularity in the paired 
comparison matrix will now decrease this sum of squares by 2. Consequently, 
the total circular triads for an individual is given by 



TCT = 1/2 




i=0 



j=i J J 






where n is the number of stimuli, and is the total number of votes in 

the j column . 
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General Goals of Life Questionnaire 
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General Goals of Life Questionnaire 



This questionnaire consists of a number of statements , arranged 
in pairs, which express what some persons have considered the main 
goals of life. In each pair, you are to decide which statement you 
consider to be the more desirable goal of life. If both statements 
seem to you to mean exactly the same thing, choose the form of 
expression which is slightly preferable to you. If you dislike both 
statements, choose the less objectionable. 

Make a choice between the statements in every pair. In choosing, 
interpret the meaning of each statement for yourself', do not worry 
over the fact that other people may give it different meanings. 

The pairs of statements in this questionnaire are numbered from 
1 to 66. In each pair choose the statement which is to you the more 
desirable expression of a goal of lifej then put a plus (+) in the 
sq uar e beside the letter of the statement you have chosen. 



Sample Answers 



I 



II 



M g] 

0 □ 

- □ 

T [+] 



In item I, the person who marked this example 
preferred statement M to statement 0. 



In item II, the person who marked this example 
preferred statement T to statement Z. 



j. 

i. 

? 



o 
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General Goals of Life Questionnaire 

K Being able to ’’take it", brave and uncomplaining acceptance 
of what circumstances bring. 

H Power; control over people and things. 

E Serving the community of which I am a part. 

D Self sacrifice for the sake of a better world. 

A Gaining personal immortality in heaven. 

G Making a place for myself in the world; getting ahead.. 

C Leading a moral life as dictated by God. 

J Finding my place in life and accepting it. 

E Serving the community of which I am a part. 

I Doing the best X can for myself. 

H Power; control over people and things. 

B Devotion to God, doing God's Will. 

J Finding my place in life and accepting it. 

A Gaining personal immortality in heaven. 

K Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 

C Leading a moral life as dictated by God. 

I Doing the best I can for myself. 

H Power; control over people and things. 

G Making a place for myself in the world; getting ahead. 

J Finding my place in life and accepting it. 

E Serving the community of which, I am a part . 

K Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 
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12 . 



13 . 



14 . 



15 . 



16 . 



17 . 



18 . 



19 . 



20 . 



21 . 



22 . 



23 . 
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□ 
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.□ 

□ 

□ 

□ 
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□ 

□ 

□ 

□ 

□ 



□ 

□ 



□ 

U 

□ 

□ 

□ 

□ 



D Self sacrifice for the sake of a better world. 

H Power; control over people and things. 

L Handling the specific problems of life as they arise. 

B Devotion to God, doing God’s Will . 

I Doing the best I can for myself. 

K Being able to ’’take it”, brave and uncomplaining acceptance 
of what circumstances bring. 

F Promoting the most deep and lasting pleasures for others 
as I can. 

A Gaining personal immortality in heaven. 

G Making a place for myself in the world; getting ahead. 

C Leading a moral life as dictated by God, 

L Handling the specific problems of life as they arise. 

I Doing the best I can for myself. 

F Promoting the most deep and lasting pleasures for others 
as I can. 

E Serving the community of which I am a part. 

D Self sacrifice for the sake of a better world. 

B Devotion to God, doing God's Will. 

H Power; control over people and things. 

L Handling the specific problems of life as they arise. 

F Promoting the most deep and lasting pleasures for others 
as I can.. 

G Making a place for myself in the world; getting ahead. 

’ 

D Self sacrifice for the sake of a better world. 

J Finding my place in life and accepting it. 

A .Gaining personal immortality in heaven. 

K Being able to "take it”, brave and uncomplaining acceptance 
of what circumstances bring. 
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*• □ 
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26. Q 
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J 


2T. Q 
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28. Q 
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□ 
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*• □ 
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□ 
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30. Q 
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** □ 
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□ 


I 


32. □ 


G 


□ 


L 


33. Q 


D 


□ 


A 


** □ 


F 


□ 
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35. □ 


B 


□ 


G 



Devotion to God, doing God's Will. 

Serving the community of which I am a part. 

Making a place for myself in the world; getting ahead. 

Self sacrifice for the sake . of a better world. 

Handling the specific problems of life as they arise. 

Finding my place in life and accepting it. 

Power ; control over people and things. 

Gaining personal immortality in heaven. 

Doing the best I can for myself. 

Self sacrifice for the sake of a better world. 

Leading a moral life as dictated by God. 

Handling the specific problems of life as they arise. 

Promoting the most deep and lasting pleasures for others 
as I can. 

Devotion to God, doing God's Will. 

Finding my place in life and accepting it. 

Doing the best I can for myself. 

Making a place for myself in the world; getting ahead. 
Handling the specific problems of life as they arise. 

Self sacrifice for the sake of a better world. 

Gaining personal immortality in heaven. 

Promoting the most deep and lasting pleasures for others 
Gts X can • 

Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. * 

Devotion to God, doing God's Will. 

Making a place for myself in the world; getting ahead. 
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□' 
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□ 
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□ 

P 

□ 

P 

□ 

□ 



c 

H 

J 

£ 

L 

F 

B 

I 

C 

D 

J 

K 

E 

6 

D 

L 

B 

C 

A 

E 

D 

F 

H 

J 



Leading a moral life as dictated by God. 

Power j control over people and things. 

Finding my place in life and accepting it. 

Serving the community of which I am a part. 

Han dl ing the specific problems of life as they arise. 

Promoting the most deep and lasting pleasures for others 
as I can. 

Devotion to God, doing God's Will. 

Doing the best I can for myself. 

Leading a moral life as dictated by God. 

Self sacrifice for the sake of a better world. 

Finding my place in life and accepting it. 

Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 

Serving the community of which I am a part . 

Making a place for myself in the world; getting ahead. 

Self sacrifice for the sake of a better world. 

Handling the specific problems of life as they arise. 

Devotion to God, doing God's Will. 

Leading a moral life as dictated by God. 

Gaining personal immortality in heaven. 

Serving the community of which I am a part. 

Self sacrifice for the sake of a better world. 

Promoting the most deep and lasting pleasures for others 
as I can. 

Power; control over people and things. 

Finding my place in life and accepting it. 




U8. Q 

□ 

49. □ 

□ 

50. Q 

□ 

51. □ 

□ 

52. Q 

□ 

53. □ 

□ 

54. Q 

□ 

55. Q 

□ 

56. Q 

□ 

57. Q 

□ 

58. Q 

□ 

59. □ 

□ 



L 



E 



C 



F 



B 

A 

H 

E 

J 

F 

I 

C 

G 

K 

A 

L 

C 

E 

B 

J 

A 

I 

D 

K 



Handling the specific problems of life as they arise. 
Serving the community of which I am a part. 

Leading a moral life as dictated by God. 

Promoting the most deep and lasting pleasures for others 
as I can. 

Devotion to God, doing God's Will. 

Gaining personal immortality in heaven. 

Power; control, over people and things. 

Serving the community of which I am a part. 

Finding my place in life and accepting it. 

Promoting the most deep and lasting pleasures for others 
as I can. 

Doing the best I can for myself. 

Leading a moral life as dictated by God. 

Mai.ing a place for myself in the world; getting ahead. 

Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 

Gaining personal immortality in heaven. 

Handling the specific problems of life as they arise. 

Leading a moral life *as dictated by God. 

Serving the community of which I am a part . 

Devotion to God, doing God's Will. 

Finding my place in life and accepting it. 

Gaining personal immortality in heaven. 

Doing the best I can for myself. 

Self sacrifice for the sake of a better world. 

Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 
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62. g 
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64. Q 
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G .Making a place for myself in the world; getting ahead. 

H Power; control over people and things. 

F Promoting the most deep and lasting pleasures for others 
as I can. 

I Doing the best I can for myself. 



K 

B 



Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 

Devotion to God, doing God's Will. 



C Leading a moral life as dictated by God. 



A Gaining personal immortality in heaven. 



I Doing the best I can for myself. 

G Making a place for myself in the world; getting ahead. 

.* 

K Being able to "take it", brave and uncomplaining acceptance 
of what circumstances bring. 

L Handling the specific problems of life as they arise. 

* 

F Promoting the most deep and lasting pleasures for others 
as I can. 

H Power; control over people and things. 
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Payments Questionnaire 
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Assume that one of the requirements of a one semester course in psy- 
chology which you are talcing is to participate as a subject in ten hours? 
of experimentation (five 2-hour sessions). Another requirement for this 
course is to write a 300 word paper every third week (5 papers in all). As 
remuneration for the experimental work, you may receive an amount of money plus 
a' number of points added to your semester grade plus the opportunity to waive 
some of the written reports. 

Consider the following pairs of sets of possible payment for the experiment 
participation. In each case you are to decide which payment set you would pre- 
fer and then make a check in the space to the left of that choice. Be sure to 
mark one payment set for every pair. 

Sample Answer: -y/ 1 5$ 9 grade pts 3 less repts 

5$ 3 grade pts 1 less rept 

In the sample the person preferred the top set as payment to the bottom. 
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6 grade pts 


2 less repts | 










10$ 


6 grade pts 


2 less repts 




15$ 


6 grade pts 


1 less - rept ' 

- s, 








36. _ 


5$ 


9 grade pts 


1 less rept 


55.. 


5$ 


6 grade pts 


2 less repts \ 










__10$ 


9 grade pts 


1 less rept 




15$ 


6 grade pts 


2 less repts . | 


: 






37. _ 


15$ 


3 grade pts 


2 less repts 


56. 


5$ 


’*J 

9 grade pts 


1 less rept \ 


■ 

i 








10$ 


3 grade pts 


1 less rept 




10$ 


3 grade pts 


1 less rept i 








• 

co 

00 


15$ 


6 grade pts 


2 less repts 


57., 


5$ 


6 grade pts 


3 less repts \ 










__10$ 


3 grade pts 


3 less repts 




15$ 


3 grade pts 


2 less repts \ 








39._ 


5$ 


6 grade pts 


3 less repts 


58.. 


5$ 


6 grade pts 


2 less repts j 






• 




__15$ 


3 grade pts 


1 less rept 




15$ 


3 grade pts 


1 less rept j 

i 








4o._ 


5* 


9 grade pts 


1 less rept 


59 v 


5$ 


9 grade pts 


ji 

3 less repts j 










— 5$ 


9 grade pts 


3 less repts 




15$ 


6 grade pts 


1 less rept 








4l._ 


15$ 


3 grade pts 


2 less repts 


60 . 


10$ 


6 grade pts 


2 less repts 










15$ 


6 grade pts 


1 less rept 




10$ 


9 grade pts 


1 less rept \ 

\ 








42. __ 


10$ 


3 grade pts 


1 less rept 


6l, 


10$ 


3 grade pts 


3 less repts 










_10$ 


6 grade pts 


2 less repts 




15$ 


3 grade pts 


1 less rept j 

5 








43._ 


5$ 


9 grade pts 


3 less repts 


62 , 


15$ 


6 grade pts 


1 less rept j 










15$ 


6 grade pts 


2 less repts 




5$ 


6 grade pts 


3 less repts \ 








44. __ 


5$ 


6 grade pts 


3 less repts 


63. 


5$ 


9 grade pts 


1 less rept 










5$ 


9 grade pts 


1 less rept 




5$ 


6 grade pts 


2 less repts 








45. __ 


5$ 


6. grade pts 


2 less repts 


64 . 


15$ 


3 grade pts 


1 less rept 










_10$ 


3 grade pts 


1 less rept 




10$ 


6 grade pts 


2 less repts 








46. __ 


5$ 


9 grade pts 


3 less repts 


65. 


15$ 


6 grade pts 


1 less rept 










_JL0$ 


3 grade pts 


3 less repts 




15$ 


6 grade pts 


2 less repts 








47. _ 


10$ 


9 grade pts 


1 less rept 


VO 

VO 


10$ 


3 grade pts 


3 less repts 










_JL5$ 


3 grade pts 


2 less repts 




10$ 


9 grade pts 


1 less rept 
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Occupations Questionnaire 



CO 



iH 



EH 



o 

ERIC 



95 



IV--2 



OCCUPATIONS 

In most communities certain occupations are accorded a higher rating than others. 
There is a tendency for us to look up to persons engaged in some occupations and down 
on those engaged in others. We may even be ashamed or proud of our relatives because 
of their occupations. 

Consider the following pairs of occupations. In each case decide which of the 
pair you feel is most looked up to, and place a check in the space to the left of that 
occupation. Be sure to mark one occupation in each pair , even if it is a sheer guess. 



1 . 


Artist 


Author 


G\ 

CVJ 


Elem school 
— — teacner 


Mail carrier 


2 . 


University 
professor 


Businessman 


30. 


Farme r 


Lawyer 


3. 


' Tailor 


Butcher 


31, 


Artist 


Butcher 


4. 


' Physician 


Carpenter 


32, 


Businessman 


Carpenter 


5- 


Mail carrier 


Clergyman 


33. 


Author 


Clergyman 


6 . 


Lawyer 


Coal miner 


34. 


University 
— — professor 


Coal miner 


7. 


Farmer 


Electrician 


35. 


Tailor 


Electrician 


8 . 


Elem school 
—— teacher 


Artist 


36, 


Physician 


Elem school 
— — teacner 


9. 


Bus ine s sman 


Author 


37, 


Mail carrier 


Farmer 


10 . 


Butcher 


University 
— — professor 


38o 


Lawyer 


Artist 


11 . 


Carpenter 


Tailor 


39. 


Carpenter 


Butcher 


12 . 


Clergyman 


Physician 


4o. 


^Clergyman 


Businessman 


13. 


Coal miner 


Mail carrier 


4i. 


Coal miner 


Author 


14. 


Electrician 


Lawyer 


42. 


Electrician 


University 
professor 


15- 


Elem school 
— teacher 


Farmer 


43. 


Elem school 
teacher 


Tailor 


16 . 


Artist 


Bu sines sman 


44. 


Farmer 

K ■ t 


Physician 


17. 


’ Author 


Butcher 


45. 


Lawye r 


Mail carrier 


18 . 


University 
— professor 


Carpenter 


46. 


Artist 


Carpenter 


19. 


Tailor 


Clergyman 


4? 0 


Butcher 


' Clergyman 


20. 


Physician 


Coal miner 


48. 


Bus ine s sman 


Coal miner 


21 . 


Mail carrier 


Electrician 


49. 


Author 


Electrician 


22, 


Lawyer 


Elem school 
— — teacher 


50. 


University 
— professor 


Elem school 
teacner 


23. 


Farmer 


Artist 


51. 


Tailor 


Farmer 


• 

-d- 

OJ 


Butcher 


Businessman 


52. 


Physician 


Lawyer 


25. 


Carpenter 


Author 


53, 


Mail carrier 


Artist 


26 . 


Clergyman 


University 
— * professor 


54. 


Clergyman 


Carpenter 


27. 


Coal miner 


Tailor 


55, 


Coal miner 


Butcher 


28. 


Electrician 


Physician 


560 


Electrician 


Businessman 
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57. • _ 


Elem , school 
— " teacher 


Author 


93. 


Clergyman 


Farmer 


58. 


Farmer 


University 
— - — professor 


9 b . 


Carpenter 


Lawyer 


59. _ 


Lawyer 


Tailor 


95. 


Butcher 


Mail carrier 


6°. _ 


Mail carrier 


Physician 


96. 


Bus i nes sman 


Physician ' 


6i« 


Artist 


Clergyman 


97. 


Author 


Tailor 


i 

OJ 

VO 


Carpenter 


Coal miner 


98. 


University 
professor 


Artist 


63, 


Butcher 


Electrician 


99. 


Electrician 


Elem school 
— • teacher 


64. 


Businessman 


Elem school 
— teacher 


100. 


Coal miner 


Farmer 


65. _ 


Author 


Farmer 


101. 


Clergyman 


Lawyer 


66. __ 


University 
— professor 


Lawyer 


102. 


Carpenter 


Mail carrier 


67. • _ 


Tailor 


Mail carrier 


103. 


Butcher 


Physician 


68. 


Physician 


Artist 


104o 


Bus inessman 


Tailor 


69. 


Coal miner 


Clergyman 


105 0 


Author 


University 
— professor 


70. _ 


Electrician 


Carpenter 
















******** 


***** 


71. __ 


Elem school 
— ■ teacher 


Butcher 








72. 


Farmer 


Businessman 








73. _ 


Lawyer 


Author 








74. • _ 


Mail carrier 


University 
— •— proressor 








75. 


Physician 


Tailor 








76. 


Artist 


Coal miner 








77. 


Clergyman 


Electrician 








78. 


Carpenter 


Elem school 
■ — teacher 






' 


79. _ 


Butcher 


Farmer 








8°. _ 


Businessman 


Lawyer 








8l. 


. Author 


Mail carrier 








82. 


University 
— professor 


Physician 








83. 


Tailor 


Artist 








1 

4» 

-=J* 

CO 


Electrician 


Coal miner 








85. 


Elem school 
— teacher 


Clergyman 








86. 


Farmer 


Carpenter 








87. _ 


Lawyer 


Butcher 








88. 


Mail carrier 


Businessman 








8 9. _ 


Physician 


Author 








90. 


Tailor 


University 
■ ■ professor 








91. ' _ 


Artist 


Electri cian 








92. 


Coal miner 


Elem school 
— — teacher 


,»i ' * 
a ■ * 
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APPENDIX V 

Offenses Questionnaire 



! 

1 

I 

i 

i 

i 

t 










O 

ERIC 







98 



n 



i 



i 

i 

i OFFENSES 

• Imagine that you were arrested for a given offense, that you were guilty 
of it, and the fact of your arrest was reported in your home town newspaper, 
j ' Consider the offenses two at a time. Which of the two under the above 

I circumstances would cause you the greater shame ? Place a check in the space 
to the left of that offense. Be sure to mark one offense in each pair, 
even if it is a sheer guess. 

| 1. Blackmail Smuggling 25. Adultery Blackmail 



1 2. 


Embezzlement 


Shoplifting 


i 3. 


Drunk driving 


Smuggling 




' Adultery 


Shopl i ft ing 


! 5. 

i 


Smuggling 


— Br jft?giais 


| 6. 


Shoplifting 


Blackmail 


f 7. 

> 


Adultery 


Tax fraud 


[ 8. 


Tax fraud 


Drunk driving 


| 9. 

i 


Blackmail 


Brib|.^gciais 


!• 10, 

• 


Smuggling 


Adultery 


1 11. 

J 


Embezzlement 


Tax fraud 


i- 12 - 

[ 13. 


B SM8Sals 


Shoplifting 


Blackmail 


Embezzlement 


1 in. 


Tax fraud 


Shoplifting 


f «• 


B Sffig?als 


Tax fraud 


( 16 . 

t 


Shopl if ting 


Smuggling 


f «• 


Drunk driving 


Embezzlement 


|. 18 . 


Tax fraud. 


Blackmail 


>• 


Embezzlement 


Adultery 


i 20. 


Drunk driving 


B1 ackmail 


| 21. 


Smuggling 


Embezzlement 


j 22 * 

|( 


B Sffi8?als 


Adultery 


f 23. 


Shoplifting 


Drunk driving 


: 2h. 


Smuggling 


Tax fraud 



1 



o 




26. 


^o^fiiials 


Drunk driving 


27. 


Embezzlement 


— B Sffig?als 


28. 


Adultery 


Drunk driving 




########## 


* * * * 
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APPENDIX VI 
Vietnam Questionnaire 
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Vietnam Questionnaire 



The following pages contain a number of statements about the war 
in Vietnam, arranged in pairs. For each pair decide which pair better 
represents your own opinion on the war and place a check in the space 
to the left of that statement. Even if you disagree with both state- 
ments, choose the one which is less objectionable. 

Make a choice between the statements in every pair. In choosing 
interpret the meaning of each statement for yourself; do not worry 
over the fact that other people may give it different meanings . 
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1. The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

Even if someone feels that the war in Vietnam is not justified, he 
should nevertheless serve at the front or wherever he is needed. 

2. Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

The Communists must be stopped now in Vietnam rather than at some 
“ ’ future time. If Hitler had been stopped earlier. World War II would 
never have occurred. 

3. ' The security of the U.S. is very much related to the security of South 

Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

4; Because right may be more important than peace, war may be the lesser 
of two evils. 

The misery and suffering caused by the war in Vietnam are not worth its 
*"* benefits. 

5. • The U.S. certainly did not appreciate outside military intervention 

during its own revolution and should not intervene in the revolutions 
of other countries. 

The U.S. has consistently stood for the principle that the people of 
*"* *” each country should have the right to determine their own political 

and social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

6. The U.S. must negotiate from a clear position of military strength 

rather than weakness. 

By supporting any South Vietnamese government in power, the U.S. has 
’ demonstrated that it is only interested in keeping the status quo. 

7. The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

8. As the National Liberation Front already has political support of a 

large part of South Vietnam, the U.S. should recognize it as the rightful 
government . 

■ The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

9. The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earlier. World War II would never 
have occurredc 

Even if someone feels that the war in Vietnam is not Justified, he should 
nevertheless serve at the front or wherever' he' is needed. 

10. There is evidence that the U.S. is supporting an unpopular government 

in South Vietnam. 

Unfortunately the Vietnamese people must suffer in order that others 
' may be spared the ravages of guerilla terrorism. 




A 



The misery and suffering caused by the war in Vietnam are not worth its 
benefits . 

The security of the LJ.S. is very much related to the security of South 
Vietnam. A victory will mean greater security and further assurance of 
a lasting peace in the future. 

The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its peoples these rights. 

Because right may be more important than peace, war may be the lesser 
of two evils. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government . 

The withdrawal of American troops that Hanoi stipulates as a prerequisite 
for peace talks is simply a trick which will enable the Viet Cong to 
take over the country. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earlier. World War II would never have 
occurred. 

Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

There .is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

The misery and suffering caused by the war in Vietnam are not worth its 
benefits . 

The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

Because right may be more important than peace, war may be the lesser of 
two evils. 

By supporting any South Vietnamese government in power, the U.S. has' 
demonstrated that it is only interested in keeping the status quo. 
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21. The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

It is difficult to imagine any situation in which the U.S. would he 
1 ~ justified in sanctioning or participating in another war. 

22. The U.S. must negotiate from a clear position of military strength 
rather than weakness . 

As the National Liberation Front already has support of a large part 
of South Vietnam, the U.S. should recognize it as the rightful 
government. 

23. The withdrawal of American troops that Hanoi stipulates as a prerequi- 

site for peace talks is simply a trick that will enable the Viet Cong 
to take over the country. 

The U.S. instigated the war. in Vietnam by never allowing the free elec- 

" tions promised by the Geneva Convention to take place throughout the 
North and South. 

2U. There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

The Communists must be stopped now in Vietnam rather than at some future 
— time. If Hitler had been stopped earlier, World War II would never have 
occurred. 

2$. lhe misery and suffering caused by the war in Vietnam are not worth its 
benefits . 

Even if someone feels that the war in Vietnam is not Justified, he 
should nevertheless serve at the front or wherever he is needed. 

26 . The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political 
and social destiny without outside intervention. The defense of South 
Vietnam gives its people that right. 

Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

27. By supporting any South Vietnamese government in power, the U.S. has 

demonstrated that it is only interested in keeping the status quo. 

___ The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assur- 
ance of a lasting peace in the future. 

28. It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

______ Because right may be more important than peace, war may be the lesser 

cf two evils. 

29. As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 

The U.S. certainly did not appreciate outside military intervention 

during its own revolution and should not intervene in the revolutions 
of other countries. 

30. The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

104 
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31. The U.S. instigated the war in Vietnam by never allowing the free elec— 

’ -dons promised by the Geneva Convention to take place throughout the 

North and South. 

There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

32 . The Communists must be stopped now in Vietnam rather than at some luture 

' time. If Hitler had been stopped earlier, World War II would never 

have occurred. 

The misery and suffering caused by the war in Vietnam are not worth its 

benefits. * 

33. Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

The U.S. has consistently stood for the principle that the people of each 
country should have the right to determine their own political and social 
destiny without outside intervention. The defense of South Vietnam 
gives its people these rights. 

34. Unfortunately the Vietnamese people must suffer in order that others 

may be spared the ravages of guerilla terrorism. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

35 . The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future . 

It is difficult to imagine any situation in which the U.S. would be 
' justified in sanctioning or participating in another war. 

Because right may be more important than peace, war may be the lesser 
of two evils. 

AsTthe rational Liberation Front already has political support of a large 
part of South Vietnam, the U.S. should recognize it as the rightful 
government . 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

The withdrawal of American trocps that Hanoi stipulates as a prerequi- 
site for peace talks is simply a. trick which will enable the Viet Cong to 
take over the country. 

38. The U.S. must negotiate from a clear position of military strength 

rather than from weakness. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

39 . The misery and suffering caused by the war in Vietnam are not worth its 

benefits. 

There is evidence that the U.S. is supporting an unpopular government 

~ in South Vietnam, 

40. The U.S. has consistently stood for the principle that the people of 

each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

The Communists must be stopped now in Vietnam, rather than at some future 
time. If Hitler had been stopped earlier. World War II would never have 
occurred. 
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41. By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

42. It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

Unfortunately the Vietnamese people must suffer in order that others 

* may "be spared the ravages of guerilla terrorism. 

43. __ As the National Liberation Front already has political support of a 

large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 

_____ The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

44. The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site forpeace talks is simply u trick which will enable the Viet Cong 
to take over the country. 

• • ' Because right may be more important than peace, war may be the lesser 

of two evils. 

4$. The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

46. The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

__ The misery and suffering caused by the war in Vietnam are not worth its 

benefits. 

47. There is. evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

The U.S. has consistently stood for the principle that the people of 

each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

*»8. The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earlier. World War II would never 
have occurred. 

— « _ By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

Even if someone feels that the war in Vietnam is not Justified, hie should 
nevertheless serve at the front or wherever he is needed. 

It is difficult to imagine any situation in which the U.S. would be 

justified in sanctioning or participating in another war. 

50. Unfortunately the Vietnamese people must suffer in order that others 

may be spared the ravages of guerilla terrorism. 

_____ As the National Liberation Front already has political support of a 

large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 
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The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future . 

The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site to peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

Because right may be more important than peace, war may be the lesser 
of two evils. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

The U.S. certainly did not appreciate outside military intervention 
during their own revolution and should not intervene in the revolutions 
of other countries. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South . 

The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

The misery and suffering caused by the war in Vietnam are not worth its 
benefits. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

It is difficult to imagine any situation in which the U.S. would be 
Justified in sanctioning or participating in another war. 

The Co mmu nists must be stopped now in Vietnam rather than at some future 

time. If Hitler had been stopped earlier, World War II would never 
have occurred. 

As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 

Even if someone feels that the war in Vietnam is not justified he should 
nevertheless serve at the front or wherever he is needed. 

The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

Because right may be more important than peace, war may be the lesser of 
two evils. 
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The U.S. instigated the war in Vietnam hy never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political 
and social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

The misery and suffering caused by the Vietnam war are not worth its 
bene fits . 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earlier, World War II would never 
have occurred. 

As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
fill government. 

Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick that will enable the Viet. Cong 
to take over the country. 

Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness . 

The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

Because right may be more important than peace, war may be the lesser 
of two evils. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

The U-S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

It is difficult to imagine any situation in which the U.S. aould be 
justified in sanctioning or participating in another war. 

The misery and suffering caused by the war in Vietnam are not worth its 
benefits. 
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As the National Liberation Front already has the political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 

There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam*. 

The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earlier, World War II would never 
have occurred. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

The U.S. certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

Because right may be more important than peace, war may be the lesser 
of two evils . 

The security of the U.S. is very much related to the security of South 
Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 
North and South. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political and 
social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

It is difficult to imagine any situation in which the U.S. would be 
justified in sanctioning or participating in another war. 

The misery and suffering caused by the war in Vietnam are not worth its 
benefits. 

As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government . 

There is evidence that the U.S* is supporting an unpopular government 
in South Vietnam. 

The withdrawal of American troops that Hanoi stipulates as a prerequi- 

s- " :cr peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

The Communists must be stopped now in Vietnam rather than at some future 
time. If Hitler had been stopped earler, World War II would never 
have occurred. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 
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81. Even if someone feels that the war in Vietnam is not justified, he 
" should nevertheless serve at the front or wherever he is needed. 

The U.S. certainly did not appreciate outside military intervention 
' during its own revolution and should not intervene in the revolutions 
of other countries. 

82. Unfortunately the Vietnamese people must suffer in order that others 

.. may be spared the ravages of guerilla terrorism. 

■ ' Because right may be more important than peace, war may be the lesser 

~ of two evils . 

83. • The security of the U.S. is very much related to the security of South 

Vietnam. A victory now will mean greater security and further assur- 
ance of a lasting peace in the future. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
1,1,1 tions promised by the Geneva Convention to take place throughout the 
North and South. 

84; • It is difficult to imagine any situation in which the U.S. would be 
. justified in sanctioning or participating in another war. 

By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

85; ' As the National Liberation Front has political support of a large part 
of South Vietnam, the U.S. should recognize it as the rightful 
government. - 

' ’ ' The U.S. has consistently stood for the principle that the people of 
each country should have the right to determine their own political 
and social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

86. The withdrawal of American troops that Hanoi stipulates as a prerequi- 
site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country. 

' ~ The misery and suffering oaused by the war in Vietnam are not worth its 
benefits . 

87. The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

There is evidence that the U.S. is supporting an unpopular government 

in South Vietnam. 

88. The U.S. certainly did not appreciate outside military intervention 

during its own revolution and should not intervene in the revolutions 
of other countries. 

The Communists must be stopped now in Vietnam rather than at some future 

time. If Hitler had been stopped earlier. World War II would never 
have occurred. 

89. Because right may be more important than peace, war may be the lesser 

of two evils. 

Even if someone feels that the war in Vietnam is not justified, he should 
nevertheless serve at the front or wherever he is needed. 

90. The security of the U.S. is very much related to the security of South 

Vietnam. A victory now will mean greater security and further assurance 
of a lasting peace in the future. 

Unfortunately the Vietnamese people must suffer in order that others 

may be spared the ravages of guerilla terrorism. 
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91. The U.S. instigated the war in Vietnam by neyer allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 

North and South. 

It is difficult to imagine any situation in which the U.S. would he 
justified in sanctioning or participating in another war. 

92 By supporting any South Vietnamese government in power, the U.S. has 

’ demonstrated that it is only interested in keepingthe status quo. 

As the National Liberation Front already has political support of a 
■ ' large part of South Vietnam, the U.S. should recognize it as the right- 
ful government . 

93. The U.S. has consistently stood for the principle that the pe°P le of 

each country should have the right to determine their own political 

and social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

The withdrawal of American troops that Hanoi stipulates as a jpre q 
site to peace talks is simply a trick which will enable the Viet Cong 

to take over the country. 

94; The misery and suffering caused by the war in Vietnam are not worth its 
benefits. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

95 There is evidence that the U.S. is supporting an unpopular government 
in South Vietnam. 

The U.S. certainly did not appreciate outside intervention during its 
own revolution and should not intervene in the revolutions of other 

countries. 

96. • The Communists must be stopped now in Vietnam rather than at some future 

time. If Hitler had been stopped earlier. World War II would never 
have occurred. 

Because right may be more important than peace, war may be the lesser of 
two evils. 

97. Even if someone feels that the war in Vietnam is not Justified, he should 
nevertheless serve at the front or wherever he is needed. 

The security of the U.S. is very much related to the security of ^outh 
' Vietnam. A victory now will mean greater security and further assur- 
ance of a lasting peace in the future . 

98. Unfortunately the Vietnamese people must suffer in order that others 
may be spared the ravages of guerilla terrorism. 

The U.S. instigated the war in Vietnam by never allowing the free elec- 
tions promised by the Geneva Convention to take place throughout the 

North and South* 

99. it is difficult to imagine any situation in which the U.S. would be 

justified in sanctioning or participating in another war. 

As the National Liberation Front already has political support of a 
large part of South Vietnam, the U.S. should recognize it as the right- 
ful government. 

100. By supporting any South Vietnamese government in power, the U.S. has 
demonstrated that it is only interested in keeping the status quo. 

The withdrawal of American troops that Hanoi stipulates as a prerequir- 
' site for peace talks is simply a trick which will enable the Viet Cong 
to take over the country . 
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101. The U.S. has consistently stood for the principle that the people of 

each country should have the right to determine their own political 
and social destiny without outside intervention. The defense of South 
Vietnam gives its people these rights. 

The U.S. must negotiate from a clear position of military strength 
rather than weakness. 

The misery and suffering caused hy the war in Vietnam are not worth 
its benefit s . 

The U.S, certainly did not appreciate outside military intervention 
during its own revolution and should not intervene in the revolutions 
of other countries. 

I 103.' ' There is evidence that the U.S. is supporting an unpopular government 

| in South Vietnam. 

! Because right may he more important than peace, war may he the lesser 

j of two evils. 

i 

! lOU. The Communists must he stopped now in Vietnam rather them at some future 

| time. If Hitler had been stopped earlier, World War II would never 

j have occurred. 

| ’ ~ The security of the U.S. is very much related to the security of South 

j Vietnam. A victory now will mean greater security and further assur- 

j ance of a lasting peace in the future . 

\ 

i 105 «' Even if someone feels that the war in Vietnam is not justified, he 

j should nevertheless serve at the front or wherever he is needed. 

Unfortunately the Vietnamese people must suffer in order that others 
| may he spared the ravages of guerilla terrorism. 
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